Increased 404 and Blocked URL Notifications in Webmaster Tools
-
In the last 45 days, I am receiving an increasing number of 404 alerts in Google Webmaster Tools.
When I audit the notifications, they are not "new" broken links, these are all links that have been pointing to non-existent pages for years that for some reason Google is just notifying me about them. This has also coincided with about a 30% drop in organic traffic from late April to early May.
The site is www.petersons.com and its been around for a while and the site attracts a fair amount of natural links so in the 2 years I've managed the campaign I've done very little link-building.
I'm in the process of setting up redirects for these urls but why is Google now notifying me of years old broken links and could that be one of the reasons for my drop in traffic.
My second issue is my I am being notified that I am blocking over 8,000 urls in my Robots file when I am not. I attached a screenshot.
Here is a link to a screenshot. http://i.imgur.com/ncoERgV.jpg
-
I doubt very much that an increase in old 404s resulted in a 30% organic traffic drop. I'd look closely at your backlink profile, competition and page quality to try and diagnose why you saw that drop in traffic.
As for the 404s I'd fix those that are fixable and 301 redirect the rest to relevant pages (or the home page). If the number is extremely large then you should put a high priority on fixing this. Otherwise I haven't met a site that Google couldn't find a 404 error on. And yeah, they keep telling you about the same ones!
Hope that helps!
Jacob
-
Hi!
As Lynn points out, there could be some issues in regards to your perceived uptime. Do you see a lot of 404 errors reported in Analytics as well? If this is the case, perhaps your hosting provider (or IT department) should have a look at this?
Also, adding the redirects seems like a good idea, as Google couold be reindexing some sites/pages linking to the old, deleted URL's.
Do you have a custom crawl frequency set up in Google Webmaster Tools? It's worth looking into if Googlebot is slowing down your site.
Good luck.Anders
-
The Moz scan is not showing the same errors. And we haven't made any technological changes. These are incoming links pointing to pages that don't exist anymore. It looks like its been that way for years, I just started getting notified of these and I'm wondering if somehow it is hurting the site.
About the robots file, I just don't know. I've decided to make it blank and re-assess in a few days.
-
Hi,
A bit difficult to say without some more details. Some of it might be outdated information. See: http://moz.com/blog/how-to-fix-crawl-errors-in-google-webmaster-tools for a rundown on how to check it if you haven't already. What urls is it flagging from the robots.txt? Are they still valid urls? In regards the 404s, 28,000 is quite a lot. Has your system changed or been updated recently? Maybe there is a systemic fault going on that is creating these errors? Is the moz scan flagging the same errors?
It is tough to say if the errors have any connection to the drop in visits, but it is certainly something you want to get to the bottom of. I threw your site into xenu (http://home.snafu.de/tilman/xenulink.html) and it was timing out on quite a few of the pages. Is it possible the site is timing out on heavy loads? That might account for the drop in organic visits also...
Lots of questions, not many answers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does it matter? 404 v.s. 302 > Page Not Found
Hey Mozers, What are your thoughts of this situation i'm stuck in all inputs welcome 🙂 I am in the middle of this massive domain migration to a new server. Also we are going to be having a very clean SEO friendly url structure. While I was doing some parsing and cleaning up some old urls I stumbled upon a strange situation on my website. I have a bunch of "dead pages" and they are 302'd to a "page not found" probably a old mistake of one of the past developers. (To clarify the HTTP Status code is not 404) Should I try to fight to get all these "dead pages" a 404 error code or could I just leave the temp redirect 302 > "page not found" ( even though I know for a fact theses pages are not going to turn on again)
Algorithm Updates | | rpaiva0 -
50% drop in search, no changes to site over 2 days, no notifications, A rank...
My URL is: http://applianceassistant.com
Algorithm Updates | | applianceassistant
With no changes to my site, I suddenly experienced a huge drop in search queries on Aug1. Your company has still given me an overall rating of A. I just thought you may be able to help or be interested in my case due to it's strange nature. Due to some suggestions on the webmaster forums, I have disavowed all low quality back links to the site, and I am currently working through each page trying to make the key words a little less spammy. Here are some screen shots of the action...
https://lh6.googleusercontent.com/-WgXUf-lvUyg/U-nrWNgspPI/AAAAAAAAAEI/imoI190LUns/s1600/Analytics_081214.tiff
https://lh4.googleusercontent.com/-srmvn288rr0/U-pxlwoycVI/AAAAAAAAAEg/ckmyX_2Sl_Y/s1600/PAGES_AUG.tiff
https://lh3.googleusercontent.com/-DVCYxhkutbQ/U-pxpQVfYfI/AAAAAAAAAEo/MN9PiLFT-zs/s1600/pages_july.tiff This appears to be almost a 50% 2 year set back. Any ideas or suggestions are greatly appreciated0 -
How Additional Characters and Numbers in URL affect SEO
Hi fellow SEOmozers, I noticed that a lot of websites have additional characters and words at the end of the URL in addition keyword optimized URL. Mostly for E-Commerce sites For example: www.yoursite.com/category/keyword?id=12345&Keyword--Category--cm_jdkfls_dklj or wwww.yoursite.com/category/keyword#83939=-37292 My question is how does the additional characters or parameters(not necessarily tracking parameters) affect SEO? Does it matter if i have additional keywords in the additional stuff in the URL (1st url example)? If you can provide more information, that would be helpful. Thank you!
Algorithm Updates | | TommyTan0 -
Images added to website automatically become URLs - is this an issue?
Hello Mozzers! I've just been trawling through a website and noticed all of the images had their own URLs. There's a bespoke CMS and that's how it works with images... So out of 1447 urls, 1314 are images. Firstly, is this an issue / problem from an SEO perspective. If it is, how should I deal with it? Thanks in advance, Luke
Algorithm Updates | | McTaggart0 -
Check canonicalization work implemented on URL
Hi I was wondering how to check canonicalization when it's not working properly - I am getting redirect from http://www to www but not from non www version to www version of URL) - so, how do I check the type of redirect in place already in the URL? Is there a tool for testing this? Thanks, Luke
Algorithm Updates | | McTaggart0 -
Has anyone else noticed a major increase in Yelp, BBB, etc. results in local SERPs, pushing business websites further down?
Across multiple cities and markets, this seems to be a trend. "Chicago coffee shop" or "Minneapolis hair salon" or "Sacramento car repair" - outside the local 7-pack, virtually every result is Yelp, BBB, Yellowpages, etc. Is this related to algo changes, or simply a result of those national sites pumping major resources into SEO? It just seems to be suddenly far more prevalent than it was even 6 months ago.
Algorithm Updates | | kpclaypool1 -
Should We Switch from Several Exact Match URLs to Subdomains Instead?
We are a company with one product customized for different vertical markets. Our sites are each setup on their own unique domains:
Algorithm Updates | | contactatonce
contactatonce.com (Brand)
autodealerchat.com (Auto Vertical)
apartmentchat.com (Apartment Vertical)
chatforrealestate.com (Real Estate Vertical) We currently rank well on the respective keyword niches including:
- auto dealer chat (exact match), automotive chat, dealer chat
- apartment chat (exact match), property chat, multifamilly chat
- chat for real estate (exact match), real estate chat To simplify the user experience we are considering moving to a single domain and subdomain structure: contactatonce.com
auto.contactatonce.com
apartment.contactatonce.com
realestate.contactatonce.com QUESTIONS:
1. Considering current Google ranking strategies, do we stand to lose keyword related traffic by making this switch?
2. Are there specific examples you can point to where an individual domain and subdomains each ranked high on Google across a variety of different niches? (I'm not talking about Wikipedia, Blogger, Blogspot, Wordpress, Yahoo Answers, etc. which are in their own class, but a small to mid size brand). Thank you,
Aaron0 -
Videos increase ranking of products in SERPS from Ecommerce Website
Just noticed something I've never seen before..and I just wanted to see if anyone else experienced this. I work for a 15000+ item eccommerce website, and today I noticed that on a few brand searches, several individual product pages were coming up. This is actually unusual because most of our individual item pages (including these) aren't ranked well enough to show up well in a brand search (and don't try to target brand terms either), but a correlation here was that both items contained videos referenced within. These were not videos hosted on our YouTube brand page either..these were videos done by separate manufacturers - one was hosted on their site, one on ours. Google actually pulled the snapshot of the video to the SERP as well... even though it was embedded within other product copy. Has anyone else noticed any preferential treatment given to effectively random items on your eCommerce website because it was augmented by video? I can assure you there was nothing otherwise unique about these products and they're not really that sought after. Neither item or url was new, and neither were the videos within. Also, this was a Universal Google search, not one for videos. (Sorry, I'm not allowed to reference directly). Thanks.
Algorithm Updates | | Blenny0