Webmaster tools crawl errors
-
Hi there,
iv been tracking my webmaster tools crawl errors for a while now(6 months) and im noticing some pages that are far gone 404 are still poping out on the crawl errors. - that pages have no data for xml linking, and remote linking are from pages that are far gone 404 also.
that pages have 404 error page + redirect to homepage, and google still notice them with old cache content.
does someone have a clue why is this happening?
-
Thank you very much Dana for the superb answer!
any clue for how much this errors are critical for my website seo? (is this problem worth fixing)
-
Hi!
Have you verified that there is a proper 301 redirect from the old URL's? If, for example, there is a 302 instead, I wouldn't be surprised if Google kept the old info in the index, as you have sort of said "I'll be back soon at this old address, just wait a minute (or year)".
Do you have an example URL for us that we could take a look at?
-
Hi Dana,
If your looking for someone to confirm what Dana said she is 100% right.
If your using a data base like WordPress it is posable for it to hold old pages and serve them. Make sure your host knows of your problem if you are using a CMS.
Hope this helps,
Thomas
-
Yes, I understand this issue very well and have seen it many times. Most often, it is happening because another of your pages that is being indexed is still referencing those pages. Please forgive Google, it is but a humble, not-so-intelligent bot (despite what the world would have you think). If you keep referencing a page that doesn't exist, Googlebot will say to itself "but it does exist! it does!" and keep indexing it, despite the 404 error. I mean, for all Google knows, it is your intention to bring that page back and maybe you just screwed up and it is 404-ing, you know?
Here's the remedy:
Do a content audit. Here's a great post on how to do that: http://www.distilled.net/blog/seo/how-to-perform-a-content-audit/
You will discover many things, without a doubt, including pages that are linking to these 404 pages. Decide what to do with those pages, i.e. nix them, re-build them, whatever. If you have pages in Google that you really do want out of the index and those same pages are 404-ing....simply go to your Google Webmaster Tools Account and in the left nav select "Google Index" and then "Remove URLs." Then simply click the box that says "create a new removal request" and enter the desired URL into that Box. Provided your page meets the requirements (and if it's producing a 404 error it does) Google will prioritize its removal. Under no circumstances should this be confused with the disavow tool. Just to make that clear.
I hope this helps. Any questions and I'm happy to help further if I can.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Webmaster Tools During GA Transition?
I'm working with a client that is launching a new website. Google Webmaster Tools can just be disconnected, then reconnected to the new Google Analytics property, correct? Without any data loss in Webmaster Tools? Thanks! Becky
Reporting & Analytics | | Becky_Converge0 -
Google Web Master Tools show that my site has been crawled, but search results show old title tags, ect.
Does the index report reflect what will be displayed on Google results? Google seems to be indexing my site every Sunday...
Reporting & Analytics | | 928shopper0 -
Webmaster Tools V. OSE Backlinks to Disavow
Hey Everybody, So I am getting to the point where I need to disavow some backlinks. I am noticing a discrepancy between the OSE backlinks and the GWMT backlinks. My question is do I put both sets of links in the Disavow tool? Just the links from GWMT? Just the links from OSE? Etc... Etc... Thanks Everybody!
Reporting & Analytics | | HashtagHustler0 -
Enabling Webmaster Tools data within Analytics
Hello, Im having a hard time connecting webmaster tools within Google Analytics i want to be able to see search queries in GA That's what Google tells me to do : "You can visit the Property Settings page in Analytics account management to change which of your Webmaster Tools sites' data you wish to show, and control which profiles on your Web Property have access to view the data." I cant find "Property Settings Page" in google analytics, or anything that has to do with "Webmaster tools" I was wandering if you can help me on that 🙂 Thanks
Reporting & Analytics | | tonyklu0 -
SEOMoz & GWT crawl error conflicting info
Site im working on has zero crawl errors according to SEOMoz (it did previously have lots since ironed out) but now looking at GWebmaster Tools saying 5000 errors. Date of those are not that recent but Webmaster Tools line graph of errors still showing aprox 5000 up to yesterday There is an option to bulk action/tick them all as fixed so thinking/hoping GWT just keeping a historical record that can now be deleted since no longer applicable. However i'm not confident this is the case since still showing on the line graph. Any ideas re this anomalous info (can i delete and forget in GWT) ? Also side question I take it its not possible to link a GA property with a GWT account if created with different logins/accounts ? Many Thanks Dan
Reporting & Analytics | | Dan-Lawrence0 -
What factors does the Keyword Difficulty Tool measure?
Hi Guys I am new to this community and finding loads of informative stuff here. The keyword difficulty tool looks very interesting. I think google keyword tool competetion field is based on PPC competetion? Will i be right in saying that the moz keyword difficulty tool measures top 10 ranking pages, their age, backlinks etc?
Reporting & Analytics | | SamBuck0 -
Site crawler hasn't crawled my site in 6 days!
On 4.23 i requested a site crawl. My site only has about 550 pages. So how can we get faster crawls?
Reporting & Analytics | | joemas990 -
Links and index missing from Google Webmaster Tools!
I've been using a wordpress blog and using google analytics and webmaster tools. I'd never done very much optimizing of my site, my strategy had always been to just keep writing relevant posts and let google do the rest. At some point I installed a SEO plugin to wordpress and did a tiny amount of tweaking, but I noticed that in my webmaster tools page, all my "links to this site" links are gone! My site map says 42 pages submitted, 42 pages indexed, but all the links that I've built over the past few years are missing, and I also notice that I can't find my main landing page in the index anymore. I know there are indexed sites out there that link to me, but they aren't being reflected anymore. Did I anger google by using SEO plugins within wordpress? I'm fairly certain I wasn't doing anything sketchy. Http://brodiegraphics.com RTOH6.png
Reporting & Analytics | | HELPeR0