How to fix a common Google Webmaster Tools crawl error on your Wordpress website
So, I just came across this issue on my Wordpress website and I thought I'd post a step by step solution to help anyone else who might come across this issue in the future:)
The issue:
You find a 405 URL error on your Google Webmaster Tools account that says "Googlebot couldn't access the page because the method specified in Googlebot's request is not allowed."
When you search for details of the error, it brings up the following URL from your website:
/wp-comments-post.php
What's that URL? It handles comment posting to your WordPress site and prevents duplicate comment posting.
Why did it come up with an error? I've got no idea, but here's how you fix it:
How to fix it:
Step 1: If you haven't already, make sure you have the "All In One SEO" plugin installed and activated on your Wordpress site
Step 2: On your Wordpress dashboard, under "All In One SEO", click on Feature Manager
Step 3: On your Feature Manager page, activate the "File Editor" feature
Step 4: Once that's activated, you will now have a "File Editor" option available under the All In One SEO menu on your Wordpress dashboard. Click on that
Step 5: Once on the File Editor page, enter the below exactly as it's typed out into the editing space provided. It might be easier for you to just copy and paste it directly.
Disallow: /wp-comments-post.php
Step 6: Scroll down and click on the "update robots.txt" button
Step 7: Check for this message at the top of the page to make sure the changes were saved successfullyStep 8: Double check that the robots.txt file has really been updated by entering it into your URL as follows:
yourdomain/robots.txt
You should see the following:
Step 9: Now go have a cup of tea and relax!
Recent Comments
3
Hi Sharon, this hasn't happened to me, but if it does I'll follow your instructions. Thanks :-)