Webmaster tools crawl errors
-
Hi there,
iv been tracking my webmaster tools crawl errors for a while now(6 months) and im noticing some pages that are far gone 404 are still poping out on the crawl errors. - that pages have no data for xml linking, and remote linking are from pages that are far gone 404 also.
that pages have 404 error page + redirect to homepage, and google still notice them with old cache content.
does someone have a clue why is this happening?
-
Thank you very much Dana for the superb answer!
any clue for how much this errors are critical for my website seo? (is this problem worth fixing)
-
Hi!
Have you verified that there is a proper 301 redirect from the old URL's? If, for example, there is a 302 instead, I wouldn't be surprised if Google kept the old info in the index, as you have sort of said "I'll be back soon at this old address, just wait a minute (or year)".
Do you have an example URL for us that we could take a look at?
-
Hi Dana,
If your looking for someone to confirm what Dana said she is 100% right.
If your using a data base like WordPress it is posable for it to hold old pages and serve them. Make sure your host knows of your problem if you are using a CMS.
Hope this helps,
Thomas
-
Yes, I understand this issue very well and have seen it many times. Most often, it is happening because another of your pages that is being indexed is still referencing those pages. Please forgive Google, it is but a humble, not-so-intelligent bot (despite what the world would have you think). If you keep referencing a page that doesn't exist, Googlebot will say to itself "but it does exist! it does!" and keep indexing it, despite the 404 error. I mean, for all Google knows, it is your intention to bring that page back and maybe you just screwed up and it is 404-ing, you know?
Here's the remedy:
Do a content audit. Here's a great post on how to do that: http://www.distilled.net/blog/seo/how-to-perform-a-content-audit/
You will discover many things, without a doubt, including pages that are linking to these 404 pages. Decide what to do with those pages, i.e. nix them, re-build them, whatever. If you have pages in Google that you really do want out of the index and those same pages are 404-ing....simply go to your Google Webmaster Tools Account and in the left nav select "Google Index" and then "Remove URLs." Then simply click the box that says "create a new removal request" and enter the desired URL into that Box. Provided your page meets the requirements (and if it's producing a 404 error it does) Google will prioritize its removal. Under no circumstances should this be confused with the disavow tool. Just to make that clear.
I hope this helps. Any questions and I'm happy to help further if I can.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
641 Crawl Errors In My Moz Report - 190 are high priority Duplicate Content
Hi everyone, There are high and medium level errors. I was surprised to see any especially since Google Analytics shows no errors whatsoever.190 errors - duplicate content.A lot of images are showing in the Moz Crawl Report as errors, and when I click on one of these links in the report, it directs to the image which displays on a blog post on the site unusually since I haven't started blogging yet.. So it looks like all those errors are because the images are appearing on their own post.So for example a picture of a mountain would be referred to with www.domain.com/mountains ; the image would be included in the content on a page but why give an image a page/post all of it's own when that was not my intention. Is there a way I can change this?# ----------------------------------------
Reporting & Analytics | | SEOguy1
These are things I first see at the top of the Moz Report: There are 2 similar home urls at the top of the report: http status code is 200 for both (1) and (2) Link Count for (1) is 71. Link count for (2) is 60. No client or server errors Rel Canonical Rel-Canonical Target
Yes http:// domain. co.uk/home
Yes http:// domain. co.uk/home/ Does this mean that the home page is being seen as a duplicate by Google and the search engines?http status codes on every page is 200.Your help would be appreciated.Best Regards,0 -
Crawl errors for pages that no longer exist
Hey folks, I've been working on a site recently where I took a bunch of old, outdated pages down. In the Google Search Console "Crawl Errors" section, I've started seeing a bunch of "Not Found" errors for those pages. That makes perfect sense. The thing that I'm confused about is that the "Linked From" list only shows a sitemap that I ALSO took down. Alternatively, some of them list other old, removed pages in the "Linked From" list. Is there a reason that Google is trying to inform me that pages/sitemaps that don't exist are somehow still linking to other pages that don't exist? And is this ultimately something I should be concerned about? Thanks!
Reporting & Analytics | | BrianAlpert780 -
Webmaster Tools and Geolocation
Our site gets a significant amount of traffic from Venezuela, about 9% based on our Google Analytics (the US being 63%). According to Webmaster Tools we get 48% of our clicks from Venezuela. That discrepancy is massive, considering we are an English site. My theory is that they are not allowed/capable of using secure search in Venezuela for some legal reason and therefore their searches are much more 'visible'. Does anyone have any insight?
Reporting & Analytics | | evansluke0 -
Pairing webmaster tools with analytics - user access
If you pair webmaster tools with an analytics account does this auto allow access for any of the authorised analytics users or do they have to be granted access individually from within GWT ? cheers dan
Reporting & Analytics | | Dan-Lawrence0 -
Backlink Profile in Webmaster Tools
The quest for the "accurate" backlink profile never ends. We now have Webmaster Tools to help us with this search. My question is whether the backlink profile according to WT is the backlink profile according to Google. Do Google's search algorithms and WT synch up? If this is the case, forget OSE and MajesticSEO, WT will be the main backlink analysis tool I use going forward. Thanks for any insight.
Reporting & Analytics | | b40040400 -
Interpreting Keyword Difficulty Tool results
I have been running various reports using the Keyword Difficulty tool. The columns are color coded - are there one set of signals that are more important than others? I am trying to analylze why we are ranking where we are and where our competitors are weak enough to overcome in a short term. I cannot seem to find a formula for the top indicatators for moving up in ranking. One of my sites in ranking number 5 but is neck and neck with the number one site for results. The other site is number 6 for the same term but has virtually no strength in the data like links, mozrank, trust, Social, etc...The sites 7-10 are much stronger on data. Maybe since they are from the same C block that helps? Any advice or experience would be helpful.
Reporting & Analytics | | devonkrusich0 -
Google Webmaster Dropped Traffic
Hi Guys, I've recently implemented a new site design with a new url architecture etc.. I set up Google Webmaster tools in early March and went live with the new site on 2nd April. Since the 6th April (4 days after going live) I've notice a drop in impressions from 15,000 - 28,000 per day to 3,500 - 5,500 per day. Now I'm kind of new to this, so after I cleaned up after my initial panic, I checked impressions vs. clicks. Impression are down 44% and clicks 31%. Not bad I thought but then again what if I dropped so far off the radar I never made an impression. 1. So first question: Are the number of impressions of a keyword independant of ranking. So if I rank #3,445,234th will I still see impressions listed but avg. position reflect #3,445,234? So while I was thinking of asking these questions I checked Google Analytics for which I have just over 3 years of metrics. Compared to the past; overall traffic and organic traffic are the same if not 10-20% better. 2. So second: Am I missing something? Its a resort website so easter just ended and you would expect the traffic to match and drop, but such a sudden and dramitic drop in Webmaster Tools impressions does not match Google Analytics. Infact Organic traffic climbed slightly. Can anyone offer any insight? Thanks, Adam
Reporting & Analytics | | NaescentAdam0 -
Duicated page error
Hi, I am trying to figure out how to fix duplicated error Most of them are from wordpress "feed" Does anyone know how to fix this problem? | Wedding Photographer San Antonio | Soobumim Photography 210-863-9878 begin_of_the_skype_highlighting 210-863-9878 end_of_the_skype_highlighting http://www.soobumimphotography.com/feed/?paged=11 21 1 0 Wedding Photographer San Antonio | Soobumim Photography 210-863-9878 begin_of_the_skype_highlighting 210-863-9878 end_of_the_skype_highlighting http://www.soobumimphotography.com/feed/?paged=12 21 1 0 Wedding Photographer San Antonio | Soobumim Photography 210-863-9878 begin_of_the_skype_highlighting 210-863-9878 end_of_the_skype_highlighting http://www.soobumimphotography.com/feed/?paged=13 |
Reporting & Analytics | | BistosAmerica0