Hello everyone, Robots.txt file is blocking my website being accessed by Google crawler. Does anyone know how to disable or delete the robots.txt file.
I have verified my
Thanks jrswab and jroth ... some how I have fixed the problem... I made some changes in web master tools... Now only my image is not displaying though I have verified ownership.... I hope it will automatically get fixed after some time. Thanks to both of you for your time and help :-)
There are no blocked urls in webmaster tools. So the problem is not because of robots.txt... Something else is causing the trouble...
Thanks jroth for your reply
I am using the following plugins:
All in one SEO plugin
Exclude Pages from Navigation
Fonts
Google Analytics for Word Press
SI CAPTCHA anti Spam
Tweet, Like, Google +1 and Share
Will any of those cause problems...
Thanks.
I'm not sure if any of those will cause that problem (they shouldn't). And changing the tile of a page shouldn't cause this either. Make sure that you do not have the robots noindex options checked in the individual posts and pages as shown in this screenshot: http://d.pr/i/kQjD
Are you using any sort of SEO plugin by chance Japhne? Lots of SEO plugins have the ability to block robots.txt and if you're not familiar with the setting it could have been easily checked by mistake.
You may also want to check and make sure you don't have the "Discourage search engines from indexing this site" option checked in the WP Admin dashboard (you can see an example here: http://d.pr/i/OlYG )
Hope this helps.
See more comments
how to delete or disable robots.txt file
Hello everyone, Robots.txt file is blocking my website being accessed by Google crawler. Does anyone know how to disable or delete the robots.txt file.
I have verified my
having similar issue, "A description for this result is not available because of this site's robots.tx" thats what i get when I search my site on google
Thanks jrswab and jroth ... some how I have fixed the problem... I made some changes in web master tools... Now only my image is not displaying though I have verified ownership.... I hope it will automatically get fixed after some time. Thanks to both of you for your time and help :-)
There are no blocked urls in webmaster tools. So the problem is not because of robots.txt... Something else is causing the trouble...
Thanks jroth for your reply
I am using the following plugins:
All in one SEO plugin
Exclude Pages from Navigation
Fonts
Google Analytics for Word Press
SI CAPTCHA anti Spam
Tweet, Like, Google +1 and Share
Will any of those cause problems...
Thanks.
I'm not sure if any of those will cause that problem (they shouldn't). And changing the tile of a page shouldn't cause this either. Make sure that you do not have the robots noindex options checked in the individual posts and pages as shown in this screenshot: http://d.pr/i/kQjD
Are you using any sort of SEO plugin by chance Japhne? Lots of SEO plugins have the ability to block robots.txt and if you're not familiar with the setting it could have been easily checked by mistake.
You may also want to check and make sure you don't have the "Discourage search engines from indexing this site" option checked in the WP Admin dashboard (you can see an example here: http://d.pr/i/OlYG )
Hope this helps.
See more comments
having similar issue, "A description for this result is not available because of this site's robots.tx" thats what i get when I search my site on google