Friday, October 20, 2023

How Search Engine Works? Crawling, Indexing, and Ranking - Complete Expl...

Hello everyone, I'm Harmeet, welcome you all on WSCubetech channel.  You must have heard a good voice today because a new mic is here.  So, I'm making a video with this for the first time.  Let me know in the comment section if the previous one was good or the voice is good now.  So let me know in the comment section.  So now let's come to the point, how do search engines work?  See, when I was not in this field, I used to think that how do search engines work?  Whenever we type something, like if I type black dress on Google, the search engine goes to the websites and checks where the black dress is and gives me the results.  I used to think like this, but it doesn't happen.  Before you type anything, before you type any keyword, Google plays a very important role.  It has already done some functions before and after that it shows you the results.  So, one by one, step by step, we will understand how this search engine works.  So, you know that there is a lot of data on the internet, that is, the world wide web.  A lot of data, that is, thousands of millions of TBs are stored here.  So, whenever the creator uploads that data, like if I made a website, I uploaded a blog, uploaded some images, made any changes to my website or a new website came, then in this way, Google's crawler, we call it, then crawler or you can also call it spider, then the crawler goes and crawls all that data, that is, it hangs on it.  It sees where the thing is, what content is on this website, it is crawling all the content before searching anything, it is seeing where the thing is and it picks up all that data and sends it to its local server.  The meaning of server is that it is saving in Google's own hard disk.  So, what did you do here, like I am talking about Google, so that you can understand better, but here I am talking about every search engine.  So, the crawler of the search engine, that is, the spider crawls the data, picks up all the data available on the internet and puts it in its local server.  We cannot see the local server, it is their local hard disk, you cannot access anyone's hard disk.  So, in the local server, the indexers of Google, what do you call them? Indexers.  So, Google's indexers, what do they do to these local servers?  They do index, that is, they divide them into different categories.  Like a website has just been created, there are a lot of dresses like black dresses, pink dresses, maroon dresses, I am just taking an example, okay?  So, Google will pick up the data from there and put it in the local server.  Now what will the indexer do?  That will separate the black dresses, separate the black shirts, apart from that, the shirts will be in a separate category.  So, the work of the indexer is to categorize, that all the data on the local server of the search engine, divide it into categories, so that Google can give relevant results to its users.  So, this is the work of indexers, okay?  So, for this, I want to give you an example so that you can understand this process very well.  Look, I have a library, I manage a library.  So now I would like to explain this concept as an example.  First, I have a library, okay?  Or say I have a bookshop.  So, I bought a lot of books from somewhere for my shop or for my library.  And I ordered a lot, so a loading taxi came, a truck came, in which all my books came.  So, I have 3 peons, so I sent one of them to go and pick up all the books from that truck.  So, what did that peon do?  He picked up all the books and put them in my library's main hall.  So, my first peon's name was Crawler, that is, Spider.  So, what did he do?  He picked up the data and threw it here, that is, he put it in my local server, that is, in my hall.  Now I told my other peon to go and pick up the books there, category-wise.  Books of Hindi became different, books of English became different.  Then in Hindi and English, like literature, economics, math’s, textbooks, magazines, newspapers became different.  So, I told him to put all the shelves of all the books in all these categories.  So, my second peon went, he picked up all the data, that is, all the books, and put them in the categories.  Now my second peon was called Indexer.  Because what did he do?  He saved my data in the categories.  Now the data that I have collected after the categories are made, is my main server, that is, the main server of Google, which is connected to us.  Now the work of 2 peons is over here.  So now it's the turn of the third peon, that is, now it's the turn of the third peon.  Now listen to what the third peon does.  Whenever a user comes and says that I want this thing, then the third peon will run and go.  And wherever the indexers have kept the book, he will bring it to him according to the query of the user.  Like he says that I want a book of literature in English, then that peon will go and find it, take that book and give it to my user.  And how will he give the book to the user?  He will give a very relevant book, whatever he wants.  So, this is what Google does.  First there was crawling, then there was indexing, and then the ranking algorithms of Google.  Like we will talk about a lot of ranking algorithms, how Google gives ranking.  So, on the basis of those ranking algorithms, Google shows you the results in the ranking.  Because all the indexing is done, the categories are divided.  But in it, which result do you have to show first, which one to show on the second number, which one to show on the third, which images to show in the images, all these things are done by the ranking algorithm.  So, the first was crawling, the second was indexing, and in the third we are talking about ranking.  So, whenever you type anything on Google, the result page you see is called SERP or SERP means search engine result page.  So, on the search engine result page, whichever ranking you see the results, who decides it?  Google's ranking algorithm decides it.  Now what are those ranking algorithms? We will understand this in the next video.  And how to work on all those ranking algorithms, how to understand who, we will talk about all this in this course.  The course you are watching this video, you will get the link in the description box, in which we are watching the complete SEO course.  Now some people have a doubt that we have to work only on ranking or rank.  The definition of SEO is that we have to rank on top.  No, we will not only talk about ranking, we will also talk about how you can do better crawling of your web pages, of your website, how can you do better indexing.  And then we will talk about ranking.  So, I will not leave any point of yours, we will complete all the points in this course.  So, make sure you subscribe to the channel and I hope you got some idea about how the search engine works.  We will talk about it in more depth in the future.  Now I have talked as much as you should know as a beginner.  If you have learned anything from this video, then don't forget to like the video.  Also, if you have any query or doubt, you can tell me in the comment section.  And save the playlist so that you don't miss a single video.  Thank you so much.

 

 

 


No comments:

Post a Comment

Long Tail vs Short Tail Keywords: What’s the Difference? - Fully Explained

If someone asks you what are short tail and long tail keywords?  And you answer that short tail means the keyword which has less  than 3 wor...