Spare A Thought For Poor Little Googlebot

byAlexEvans

11.9K followers

7 years ago

Every day of the week, fifty-two weeks of the year, come rain, hail, shine, or crack fizzle pop, he has to get up out of his little bed and crawl his way around

20 billion plus pieces of content.

Regardless of how he feels.

I am sure that some days he cries out;

"Boss I can't do this anymore "

When that " RSI " starts to raise its head, the folks in the office say:

" You can do this Goggie "

We'll help by making your job easier, hang in there.

" You can do this ".

You kind of start feeling sorry for the little man.

Googles mantra is that it wants to find, new, fresh, unique, relevant and important content that adds value and that loads efficiently, ( as in fast ), and which now looks good on mobile devices, this, in turn, enables Google to give the user the best experience both in use and in the results that they are presented with.

As time progresses marketers and content creators push the boundaries and stretch that rubber band sometimes until it just about breaks.

Now and then they need a realignment to bring things back to the core values so that things are in an equilibrium.

Just like water, everything finds its own level.

For content creators, the whole process starts with indexing, how do they actually do that in layman's terms, considering that part of the process, crawling content occurs more than 20 billion times a day which equates to trillions of pieces of content in a year.

Mind boggling, how on earth do they find my 1000 words floating in that gigantic ocean of content. One of the bizarre things is that every day 15% of new search queries are just that totally new which is definitely a ray of sunshine. Another plus is that for every link that is found there are another two links behind that or standing to the side and related to.

It is like your car to a degree, as technology expands you just jump in and drive it blissfully unaware of what is happening under the bonnet, turn the key or push the button as the case may be and away we go.

From observation, there are two processes happening, first up GB while cruising around comes across your content, and the next thing is that there is a scheduling process happening in the background, so what is happening, when content is found, is that the system is continually deciding what to crawl, what to update, what to avoid and most of all what is the most efficient way to go about this whole process.

When the crawlers turn up to your content, one of the first tasks that they will do is look for permission, in machinery talk, they will look at the Robot.txt file which holds the instructions for what they are allowed to look at or fetch and what they are not allowed to look at, they will follow these instructions to the letter.

The next thing to happen is that they will get as much content as they can without putting pressure on the server/host or impeding the functionality of the website.

The third thing is GB will do is look at errors on the page with that okay,

" I don't have to comment on everything I see and observe".

At this point, I believe we call it " being indexed ", there is more to come, Google has found you, it is kind of like going to the doctor and then the doctor saying I would like to check this out further, we will send you along to the specialist.

In this case, the specialist is a system of scheduler's that cue the URL's and content then direct GB to follow up they are effectively rendering that content, kind of like going over something with a fine-toothed comb, based on the information gathered they will end up making decisions about that content, in effect ranking that content or site.

The upshot of the whole process is that Google is trying to understand the content, the message that is being expressed, what the content it is about, the problem that it is creating or trying to solve, so that it can package it, and put it in a cubby hole, in an order of priority against all the other pieces of content that are of a similar nature.

At this point, the content is being ranked.

One of the key things we could do is to make our content as easy for GB to discover and understand as possible, crisp clean, and to the point. We often hear that Google has 200 plus ranking factors, there is a lot of conjecture about relevance and importance of the various factors.

The thing is that there are certain things that Google does not want to see, because they devalue the whole process which in turn erodes the user's experience. Up dates come to keep things real, Google has just rolled out an update that started around the first of August, it will impact some content and sites, in this situation, Google will neither confirm nor deny what exactly they have done to tweak the algorithm and everyone that is effected is running around trying to counter or find out how they can adjust and adapt to the update.

The best thing we can do is chip away and work hard at creating a really positive online presence, work towards creating the best practice for the content that we create. The whole process is so logical and Google is only trying to do the best for the folks that use the internet, to make it the best environment that it can be and like all things that process is continually evolving, for Google and all the content creators that make the internet what it is today and moving forward.

As content creators, we owe it to ourselves and also to the folks that we are creating content for, to get the best education, knowledge, and resources that we can lay our hands on, so we can create just what folks are searching for.

The mantra could be add value, add value and add value.

Looking around the internet at large, that is where Wealthy affiliate comes into its own, we are well-placed to meet what Google requires and what people require and are looking for to meet their needs and expectations of and from the internet.

By forming a partnership with Google and our audiences it is a win-win for everyone.

So " go Gogglebot go ", you are welcome over when ever you want to drop on by, feel free, the coffee pot is on the stove and there is always time for a yarn.

Thanks for reading, what do you think?

Alex Evans