Sudden influx of 404's affecting SERP's?
-
Hi Mozzers,
We've recently updated a site of ours that really should be doing much better than it currently is. It's got a good backlink profile (and some spammy links recently removed), has age on it's side and has been SEO'ed a tremendous amount. (think deep-level, schema.org, site-speed and much, much more).
Because of this, we assumed thin, spammy content was the issue and removed these pages, creating new, content-rich pages in the meantime.
IE:
-
We removed a link-wheel page; <a>https://www.google.co.uk/search?q=site%3Asuperted.com%2Fpopular-searches</a>, which as you can see had a **lot **of results (circa 138,000).
-
And added relevant pages for each of our entertainment 'categories'.
<a>http://www.superted.com/category.php/bands-musicians</a> - this page has some historical value, so the Mozbar shows some Page Authority here.
<a>http://www.superted.com/profiles.php/wedding-bands</a> - this is an example of a page linking from the above page. These are brand new URLs and are designed to provide relevant content.
The old link-wheel pages contained pure links (usually 50+ on every page), no textual content, yet were still driving small amounts of traffic to our site.
The new pages contain quality and relevant content (ie - our list of Wedding Bands, what else would a searcher be looking for??) but some haven't been indexed/ranked yet.So with this in mind I have a few questions:
- How do we drive traffic to these new pages? We've started to create industry relevant links through our own members to the top-level pages. (http://www.superted.com/category.php/bands-musicians) The link-profile here _should _flow to some degree to the lower-level pages, right? We've got almost 500 'sub-categories', getting quality links to these is just unrealistic in the short term.
- How long until we should be indexed? We've seen an 800% drop in Organic Search traffic since removing our spammy link-wheel page. This is to be expected to a degree as these were the only real pages driving traffic. However, we saw this drop (and got rid of the pages) almost exactly a month ago, surely we should be re-indexed and re-algo'ed by now?!
- **Are we still being algor****hythmically penalised? **The old spammy pages are still indexed in Google (138,000 of them!) despite returning 404's for a month. When will these drop out of the rankings? If Google believes they still exist and we were indeed being punished for them, then it makes sense as to why we're still not ranking, but how do we get rid of them? I've tried submitting a manual removal of URL via WMT, but to no avail. Should I 410 the page?
- Have I been too hasty? I removed the spammy pages in case they were affecting us via a penalty. There would also have been some potential of duplicate content with the old and the new pages.
_popular-searches.php/event-services/videographer _may have clashed with _profiles.php/videographer, _for example.
Should I have kept these pages whilst we waited for the new pages to re-index?
Any help would be extremely appreciated, I'm pulling my hair out that after following 'guidelines', we seem to have been punished in some way for it. I assumed we just needed to give Google time to re-index, but a month should surely be enough for a site with historical SEO value such as ours?
If anyone has any clues about what might be happening here, I'd be more than happy to pay for a genuine expert to take a look. If anyone has any potential ideas, I'd love to reward you with a 'good answer'.Many, many thanks in advance.
Ryan.
-
-
Hi Monica,
Thanks for the fast response.
I'm a bit wary of 301 redirecting the old pages -- this would be extremely easy to do - however: if we were being penalised on those old pages, wouldn't this just redirect all the penalties to our new squeaky clean pages?
I submitted a new sitemap to Google the day we made the changes -- probably about three weeks - a month ago including the new URLs (or as many as we could include with the 500 URL limit) and removing the old spammy ones.
Penalty-wise, we've never had a manual warning or anything in WMT. However, this doesn't discount the idea that we may have been suffering an algorithm penalty, right?
It'd be great to hear from anyone about their experience with 301's and the likeliness of passing on 'bad' linkjuice from old pages (does this even happen?).
Also whether a 410 would help - stops all the 404 errors from continuously occurring and Google assuming there's something bizarre going on.Thank you again.
-
How do we drive traffic: In light of removing these old pages, and seeing a tremendous influx of 404 errors, I am assuming the pages that were removed were not 301 redirected. If that is the case I would strongly encourage you to redirect those old URLs to your new pages. This will help get traffic to the new pages which will eventually help them rank on their own. It sounds like your pages just dropped off the face of the planet and because the other pages are so new, you are losing all of your organic rankings and subsequently, organic traffic.
How long should you wait to be indexed: Did you submit a new sitemap to Google? I would make sure you have done that. After that, it shouldn't take very long, 2 weeks is the longest I have waited for an index after a sitemap submission.
As far as a penalty goes, check WMT. If you see nothing in there from Google I think you are safe on the penalty side. However, the sudden changes, the large amount of changes and the influx in 404 pages might have moved your site back in rankings while Google takes a look to make sure there isn't any nefarious activity. I wouldn't worry about a penalty unless you actually receive one.
If you are worried about duplicate content, try researching Rel canonical tags to see if they will be helpful to you. It sounds like you made a lot of changes quickly, and that Google needs time to investigate. Unfortunately, you have to kind of wait a little bit. Try the things I listed here, I hope that it helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Nuisance visitors to non active page. What's going on?
Hi Guys, for the past several months, I get high volume of searches on a non-existing page /h/9249823.html. These searches come from all over the world from different domains and have a zero session duration. They are automatically forwarded to my home page. The source re Google Analytics is 12-reasons-for-seo.com. The full referrer is 12.reasons-for-seo.com/seo2php. Any idea what is provoking this activity? Any chance it's screwing with my legitimate search results or rankings?
White Hat / Black Hat SEO | | Lysarden0 -
I would like opinions on Brian Dean's training courses and his advice -- is it useful?
I would like opinions on Brian Dean's training courses and his advice -- has anyone used it successfully? Is it worth the cost? And useful?
White Hat / Black Hat SEO | | marketingdepartment.ch1 -
Why did this fabric site disappear for "fabric" and why can't we get it back?
Beverlys.com used to rank on the first page for "fabric." I'm trying to get the date of their demise, but don't have it yet so I can't pinpoint what Google update might have killed them but I can guess. In doing a backlink analysis, there were hundreds of poor quality, toxic sites pointing to them. We have carefully gone through them all and submitted a disavow request. They are now on page 9 from nowhere to be found a week ago. But, of course, that's not good enough. They are on page 2 for "fabric online" and "quilt fabric." So Google doesn't completely hate them. But doesn't love them enough even for those terms. Any suggestions? They are rebuilding the site to use a different ecommerce platform with new content and new structure. They will also be incorporating the blog within the site and I've advised them on many other ways to attract traffic and backlinks. That's coming. But for now, any suggestions and help will be much appreciated. Something has got to be holding them back for that one gem of a keyword. Also, I would like to know what experiences others have had with the disavow request form. Does Google absolutely hold you to making every attempt you can at getting those links removed? ANd how does it know? No one responds so it seems to be such a waste of time. And many now actually charge to remove your links. Thoughts? Thanks everyone!
White Hat / Black Hat SEO | | katandmouse0 -
The wrath of Google's Hummingbird, a big problem, but no quick solution?
One of our websites has been wrongfully tagged for penalty and has literally disappeared from Google. After lot's of research, it seems the reason was due to a ton of spammy backlinks and irrelevant anchor text. I have disavowed the links, but the results are still not rebounding back. Any idea how long the wrath of Google gods will last?
White Hat / Black Hat SEO | | Mouneeb0 -
Server down - What will happen to the SERP?
Hi everybody, we have a lot of websites (about 100) on one Server in Italy. This Server crashed 5 days ago and now it should go online (I hope!). What will happen to the SERP? What shall I do to recover the rank of every key? New links, new content, just wait...what? Tnks 😉
White Hat / Black Hat SEO | | Sognando0 -
What's the right way to gain the benefits of an EMD but avoid cramming the title?
Hi Guys, Say I'm (completely hypothetically) building weddingvenuesnewyork.com and right now I'm organizing the tags for each page. What's the best layout so that I can optimize for "wedding venues new york" as much as possible without it becoming spammy. Right now I'm looking at something like "Wedding Venues New York: Wedding Receptions and Ceremony Venues" for the title.. To get other strong keywords in there too. Is there a better layout/structure?.. And is having the first words of the title on the homepage the same as the domain name going to strengthen the ranking for that term, or look spammy to Google and be a bad move? This is a new site being built
White Hat / Black Hat SEO | | xcyte0 -
Negative SEO on my website with paid +1's
Hi guys, I need a piece of advice. Some scumbag played me quite well with paid +1's on my two articles and now I'm in a problem.
White Hat / Black Hat SEO | | Fastbridge
http://sr.stateofseo.com/seo-vesti/google-implementacija-ssl-protokola-not-provided-problem/
http://sr.stateofseo.com/napredni-seo/najnovije-promene-google-panda-algoritma/
They are both translated articles (written originally by me on the same website). I've noticed those +1's (476 on both articles) when my website received a penalty for "SEO" keyword on Google.rs (Serbian Google) and I'm now on the 11th page.
Other keywords still rank just fine. Not cool, right? Now, I think there could be two solutions:
First one is to remove my inner link that's pointing to my homepage with "SEO" anchor, and hope for the best. Second one is to completely remove/delete those two articles and wait for Google to reindex the website and hopefully remove my ban. Do you guy have some other ideas how can I fix this or remove / disavow those +1 or somehow explain to the Google crew / algo that I'm just a humble SEO without any evil thoughts? 🙂 Thank you in advance.0 -
I've done some link building on my website... why is google showing this?
Hi guys, it seems Google is going crazy as always, basically sometimes i'm ranked first page sometimes i'm not there, not sure if it's because of my link building and Google is indexing the links. At the moment in IE i'm top 3-4 for this keyword however the Title tag is not what I set it to be it's basically taking the product name then adding something after it. (I know google sometimes changes to what they want if they feel its more relevant but it isn't in this case) Not sure if this is normal for my keyword to keep appearing then dissapearing in Google. I noticed in FF my keyword isn't there but in IE it is. I've logged out of my Google account deleted all history/cookies etc. Even checked on my friends computer. Hope this makes sense and i'm not going crazy!
White Hat / Black Hat SEO | | InkCartridgesFast0