Webmaster tools crawl errors
-
Hi there,
iv been tracking my webmaster tools crawl errors for a while now(6 months) and im noticing some pages that are far gone 404 are still poping out on the crawl errors. - that pages have no data for xml linking, and remote linking are from pages that are far gone 404 also.
that pages have 404 error page + redirect to homepage, and google still notice them with old cache content.
does someone have a clue why is this happening?
-
Thank you very much Dana for the superb answer!
any clue for how much this errors are critical for my website seo? (is this problem worth fixing)
-
Hi!
Have you verified that there is a proper 301 redirect from the old URL's? If, for example, there is a 302 instead, I wouldn't be surprised if Google kept the old info in the index, as you have sort of said "I'll be back soon at this old address, just wait a minute (or year)".
Do you have an example URL for us that we could take a look at?
-
Hi Dana,
If your looking for someone to confirm what Dana said she is 100% right.
If your using a data base like WordPress it is posable for it to hold old pages and serve them. Make sure your host knows of your problem if you are using a CMS.
Hope this helps,
Thomas
-
Yes, I understand this issue very well and have seen it many times. Most often, it is happening because another of your pages that is being indexed is still referencing those pages. Please forgive Google, it is but a humble, not-so-intelligent bot (despite what the world would have you think). If you keep referencing a page that doesn't exist, Googlebot will say to itself "but it does exist! it does!" and keep indexing it, despite the 404 error. I mean, for all Google knows, it is your intention to bring that page back and maybe you just screwed up and it is 404-ing, you know?
Here's the remedy:
Do a content audit. Here's a great post on how to do that: http://www.distilled.net/blog/seo/how-to-perform-a-content-audit/
You will discover many things, without a doubt, including pages that are linking to these 404 pages. Decide what to do with those pages, i.e. nix them, re-build them, whatever. If you have pages in Google that you really do want out of the index and those same pages are 404-ing....simply go to your Google Webmaster Tools Account and in the left nav select "Google Index" and then "Remove URLs." Then simply click the box that says "create a new removal request" and enter the desired URL into that Box. Provided your page meets the requirements (and if it's producing a 404 error it does) Google will prioritize its removal. Under no circumstances should this be confused with the disavow tool. Just to make that clear.
I hope this helps. Any questions and I'm happy to help further if I can.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Analytics and Webmaster Tools Setup for Agencies
Hi, As agencies, what are people finding to be the best practices for allowing multiple members of the agency's team to access client WMT and GA data? Have a generic "analytics@myagency.com" account that's used for the shares, that anyone in the agency can use as needed (limited, of course, not admin). Have the individual person at the company use their company email for the share for each particular client? employee@agency.com. Yet what happens when we need someone else to check the GA or WMT data? Any advice is much appreciated.
Reporting & Analytics | | Titan552
Thank you!0 -
Pairing webmaster tools with analytics - user access
If you pair webmaster tools with an analytics account does this auto allow access for any of the authorised analytics users or do they have to be granted access individually from within GWT ? cheers dan
Reporting & Analytics | | Dan-Lawrence0 -
How to link Analytics to Webmaster Tools at the profile level?
What do you do when you have a few profiles under one property in analytics (for subdomains etc) but you want to link each one of them to webmaster tools? Far as I know, you can only link them at the property level. Thanks! -Dan
Reporting & Analytics | | evolvingSEO0 -
Difference between site: search and Total Indexed in Google Webmaster Tools.
This morning I did a search on Google for my site using the site: operator. I noticed that the number of results returned was significantly different than the "Total indexed" in Google Webmaster Tools. What is the difference and is it normal to have two very different numbers here?
Reporting & Analytics | | Gordian0 -
Rank tracker tool - seomoz
Hi All, I have noticed that ranks in the tool -rank tracker are not correct for my keywords sometimes. Does anybody else has experienced this? Isn't it real time updated? What other free rank tracker tool you guys would suggest which can send you weekly accurate updates? Thanks
Reporting & Analytics | | EG0CENTRIX0 -
OSE shows URLs redirecting to our custom created error page, is this a problem?.
When I check the link metrics for my product pages in OSE, it shows a message saying that the page redirects to our custom error page. This page was recently created to display when there is an error with the website. Do I need to be concerned that OSE is seeing all product pages as redirecting to this error page? Will it affect page authority etc,? I have attached a screen shot of the message that OSE displays for reference. YWbpM.jpg
Reporting & Analytics | | pugh0 -
WMT tools - setting parameter for redirected URLs
Hi everybody. One of our clients has recently moved from one ecommerce platform to another. During the move, a huge number of URLs have been tidied up to remove dynamic parameters. The old URLs have been redirected to the new, tidy ones. My question is whether it's worth telling Google in the WMT URL parameters section not to index the parameters of the old URLs. Will this affect the redirects in any way? Thanks!
Reporting & Analytics | | neooptic0 -
Indexed URLs in Webmaster Tools
Hi everybody! I've been looking at my Webmaster Tools stats, and it looks like not all the URLs in the sitemap tree have been indexed, according to WMT at least. Is this reliable, and if so, is it worth investigating further? | Sitemap | Status | Type | Downloaded | URLs submitted | URLs in web index |
Reporting & Analytics | | neooptic
| | /ISitemap1.xml | | Sitemap | Dec 15, 2011 | 2,000 | 1,309 |
| | /isitemap.xml | | Index | Dec 15, 2011 | 8,695 | 4,127 |
| | /isitemap2.xml | | Sitemap | Dec 15, 2011 | 2,000 | 998 |
| | /isitemap3.xml | | Sitemap | Dec 15, 2011 | 2,000 | 819 |
| | /isitemap4.xml | | Sitemap | Dec 15, 2011 | 2,000 | 719 |
| | /isitemap5.xml | | Sitemap | Dec 15, 2011 | 695 | 282 | Thanks!0