Can anybody tell me how to fix this problem, please?
No: blocked by robots.txt
Failed: Blocked by robots.txt
I'm using all in one SEO if that makes any difference?

Join the Discussion
Write something…
Recent messages
Triblu Premium
Hey Lisa,

The following video may provide you with the help you seek: OR Hope this helps you.
Reply
LMH1968 Premium Plus
Very much appreciated :-)
Reply
davehayes Premium
I'd ask support.
Reply
LMH1968 Premium Plus
Thanks Dave :-)
Reply
davehayes Premium
Glad to be of help
Reply
Jaz333 Premium
I am assuming you saw this error in search console? I have seen this issue before. It means that google has indexed a page/post even though they were blocked by your robots.txt file.

You can find more info on this error and a possible fix here: https://www.contentkingapp.com/academy/index-coverage/faq/indexed-blocked/

If you are seeing this error when using the url inspection tool when checking indexing, it could mean the page/post has not been indexed because it was blocked by the robots.txt file.

I am trying to reach back into my memory bank to remember how I fixed this issue way back when lol. If anything more pops into my head I'll come back and add it :D

Good luck, Shannon
Reply
LMH1968 Premium Plus
Yes, correct Shannon from the search console. Thanks for the answers, my friend :-)
Reply
JohnDenekar Premium
It is in your seo, under advance. Use the drop down box, then scroll to where the txt bot is and simply delete that content in the box. Hope this helps.
Reply
LMH1968 Premium Plus
Yes that helps my friend Thanks :-)
Reply
JohnDenekar Premium
You are very welcome.
Reply
AbieAJ Premium Plus
Hi

Few possible scenarios below, however may be I think your site has not been crawled yet.

https://webmasters.stackexchange.com/questions/117773/google-started-to-reports-root-url-blocked-by-robots-txt-but-its-not
Reply
LMH1968 Premium Plus
Thanks for the answers my friend :-)
Reply
AbieAJ Premium Plus
So very welcome, let us know how you get on.
Reply
JeffreyBrown Premium
I want to see what answers you get, Lisa!
Reply
Top