Important BERT Google Algorithm Update Tips

BERT [Bidirectional Encoder Representation from Transformer]- Released on Oct 24, 2019

It’s a deep learning algorithm related to Natural Language Processing. It helps machines to understand what words in a sentence mean, but with all the context of the content.

Example Query- Order food online

Before- List of Restaurants

After- Food order delivery site

It can also be understood by the following query

Query – Math Practice books for adults.

Before –Search Engine picks phrases as young adults and suggests the results for 6-8 grade.

After- It displays results for grownups

What is Google NLP?

NLP is the framework that powers Google BERT. Natural Language Processing is the technology behind-

  1. Google Translate
  2. Microsoft word
  3. Grammarly
  4. Ok Google
  5. Cortona
  6. Alexa

Natural Language Processing Analysis of sentence

Syntax Analysis – Who is the Father of Science

  1. Who Tag Pronoun
  2. is day singular
  3. the tag determiner
  4.  of day preposition
  5.  science tag noun

Sentiment Analysis

Google’s sentiment analysis. assign an emotional score to a query

3. Entity Analysis

In this Google picks entities and generally uses Wikipedia as a database.

4. Entity Sentiment Analysis

Google goes one step further by adding the score for entities

5. Text Classification Provides a closest matching it with the closest category

Google matches the Closest subcategory of web pages depending on the query entered by the user.

BERT is a way to understand Relationships between Sentences

Sentence A- The man went to the Store

Sentence B – He bought milk

Label – Intext sentence.

Sentence A – The main went to store

 Sentence B: Penguins are flightless

Label – Not next sentence as no correlation

How exactly does BERT work?

Before BERT- Google looked at the sequence of words in the query either from left to right or right to left.

After BERT- Google has trained its systems to look bidirectionally at the query. This means Google can now look at queries both ways (from the right or left in single processing.


We went to the riverbank

I need to go to the bank to make a deposit

So, it’s from right to left and left to right.

Any questions?

You can reach me at

Shruti Panwar

I am Digital Marketer having almost 8 years of professional experience and am fond of doing SEO projects. Today where everything is digitalized, I have created this site to learn digital marketing online.

Leave a Reply

Your email address will not be published.