Join the Discussion
mijareze
Premium
I eould like to have seen what to do if you cannot crawl and fetch because your site has blocked the bots. My site has not been verified and is blocked due to Javascript and css I believe. I've had a heck of a time with this situation but I am not very tech saavy. Any help will be much appreciated!
Reply
mijareze
Premium
I added filters to my websites to filter out the spam bots in Analytics. It worked great but now that several months have passed I noticed they are back. There is a website that offers the free service. You have to update by blocking out the new url's belonging to the spam bots.
Ed
Ed
TopAchiever
Premium
I would've said this is an incomplete tutorial. Surely you can suggest some solution for the Denied items?
Quasar_wpg
Premium
Now I just need to figure out how to fix the things it doesn't see. I have some scripts and images it says robots.txt denied. Do these things matter if the rendered page looks alright?
onefineham
Premium
That would depend entirely if it is important (to you) that Google sees and/or indexes those items which are missing or blocked.
Quasar_wpg
Premium
I disabled my social plugins and most of the script errors went away, all but 2. I guess the extra button and widget scripts don't matter too much to rankings? The two that were left related to JQuery something.
