Search Console Page
Have you ever seen your Google Search Console page looking similar to the image below? I think that most have or will have this experience at one point or another if they have a website that they’re promoting online. This report showing “Site Errors” and “URL Errors” will be seen when G is having a problem crawling a URL that was indexed previously on your site. The following will explain just how to fix Google crawl error reports.
Here are 4 different types of Crawl errors that you may or not see after Google has been crawling your website pages.
If your website is set up properly there should be no site error issues when G’s bot comes a-crawling, and usually or in the majority of sites there aren’t any site errors after the kinks get worked out. Google will let you know if there are a number of errors by contacting you by email or whatever contact info that was set up previously. You should get familiar with Googles Webmaster Tools as they are free and very useful.
As you can see in the above image there is 1 result with:
1. Access Denied
This means that the Google crawlers were denied access to a page(s) for some reason. Website crawl errors will certainly keep your page from appearing in the search engine results pages (serp’s). You’ll need to make sure that there’s no firewall or server authentication issues preventing G’s crawlers from roaming free range on your site. You can see Googles Guidelines For WordPress sites with a simple search and also be sure to setup your robots.txt file according to the guidelines. Another type of error that you might see are:
2. Server Errors
Googles little crawler bots are letting you know that they can’t freely roam throughout your site due to your server and they’ll give you an error code that they received from your server. Usually these are just temporary so don’t panic, however if you were to get this type of error often it could very well be a problem with your server. You would then give your hosting company the error codes that G’s crawlers are reporting and they should be able to solve the issue for you.
3. A Soft 404 error
is when instead of connecting the searcher with the desired page, they get another page like the home page instead of the 404/ Not Found. Another and the most common is the:
4. 404/Not Found errors
These ugly empty pages with only 404/ Page Not Found written can be discouraging for the viewer and might even cause a few to leave your site. A common reason for needing to fix this crawl error report is if you’ve gone through and updated pages and deleted one or more, or maybe you changed permalink titles (don’t do that).
Even though a previously published page has been deleted, if the GBot crawls your site and doesn’t find all the URL’s that it crawled the last time it went through the site, it takes notice. Instead it gets the 404/Not Found error due to the no longer existing page and the searcher will see the ugly page instead of the expected content page.
So find out the reason for the non-existing urls and delete the original pages if you haven’t already or you can use the download button and get a list of the not found pages and use Google Webmaster’s URL Removal tool and enter the enter the url’s into the removal tool box and make them disappear. Make sure to check each error to see why the GBot can’t freely crawl on the url. A couple more reasons why you might get the 404/Not found error are:
5. You might need to use a plugin to create a “301 redirect” from an old url to the new url. See #6 and image.
6. If your permalink structure or url changed use the 301 redirect plugin from the old to the new one.
Simply go to your plugins page and put “301 redirect” in the search box (see above) and you’ll see a number of plugins to choose from, just make sure that the plugin is tested and compatible with your site. As you can see in the image there are 231 search results, the one shown I wouldn’t choose because it says Untested with my version of WordPress and it’s been about a year since updated. There are many that have been updated recently and are also tested and compatible with my version of WordPress.
7. Monitor your site regularly for broken links and images and fix them asap. You can add a plugin, a broken link checker, to do just that. Simply follow the steps above with the exception of putting “broken link checker” in the search box.
I must say that each and every time I’ve gone through my posts and pages, I’ve found a few things to change or edit in order to make an improvement or two. Be sure to fix all of your sites crawl errors quickly in order to satisfy your viewers and also to keep your search engine rankings from dropping. It’s important to know of these 7 problems and solutions that can make quite a difference in earnings gained or not, because good search engine rankings attract online viewers and that’s the whole point of having your website. So now you know how to fix Google crawl error reports, keep an eye on and as said earlier fix as soon as you can to protect and propel your websites rankings.
Wealthy Affiliate Review: $1600 Per Month From One Website With This Awesome Training!
Getting Started In Online Business