Sudden influx of 404's affecting SERP's?
-
Hi Mozzers,
We've recently updated a site of ours that really should be doing much better than it currently is. It's got a good backlink profile (and some spammy links recently removed), has age on it's side and has been SEO'ed a tremendous amount. (think deep-level, schema.org, site-speed and much, much more).
Because of this, we assumed thin, spammy content was the issue and removed these pages, creating new, content-rich pages in the meantime.
IE:
-
We removed a link-wheel page; <a>https://www.google.co.uk/search?q=site%3Asuperted.com%2Fpopular-searches</a>, which as you can see had a **lot **of results (circa 138,000).
-
And added relevant pages for each of our entertainment 'categories'.
<a>http://www.superted.com/category.php/bands-musicians</a> - this page has some historical value, so the Mozbar shows some Page Authority here.
<a>http://www.superted.com/profiles.php/wedding-bands</a> - this is an example of a page linking from the above page. These are brand new URLs and are designed to provide relevant content.
The old link-wheel pages contained pure links (usually 50+ on every page), no textual content, yet were still driving small amounts of traffic to our site.
The new pages contain quality and relevant content (ie - our list of Wedding Bands, what else would a searcher be looking for??) but some haven't been indexed/ranked yet.So with this in mind I have a few questions:
- How do we drive traffic to these new pages? We've started to create industry relevant links through our own members to the top-level pages. (http://www.superted.com/category.php/bands-musicians) The link-profile here _should _flow to some degree to the lower-level pages, right? We've got almost 500 'sub-categories', getting quality links to these is just unrealistic in the short term.
- How long until we should be indexed? We've seen an 800% drop in Organic Search traffic since removing our spammy link-wheel page. This is to be expected to a degree as these were the only real pages driving traffic. However, we saw this drop (and got rid of the pages) almost exactly a month ago, surely we should be re-indexed and re-algo'ed by now?!
- **Are we still being algor****hythmically penalised? **The old spammy pages are still indexed in Google (138,000 of them!) despite returning 404's for a month. When will these drop out of the rankings? If Google believes they still exist and we were indeed being punished for them, then it makes sense as to why we're still not ranking, but how do we get rid of them? I've tried submitting a manual removal of URL via WMT, but to no avail. Should I 410 the page?
- Have I been too hasty? I removed the spammy pages in case they were affecting us via a penalty. There would also have been some potential of duplicate content with the old and the new pages.
_popular-searches.php/event-services/videographer _may have clashed with _profiles.php/videographer, _for example.
Should I have kept these pages whilst we waited for the new pages to re-index?
Any help would be extremely appreciated, I'm pulling my hair out that after following 'guidelines', we seem to have been punished in some way for it. I assumed we just needed to give Google time to re-index, but a month should surely be enough for a site with historical SEO value such as ours?
If anyone has any clues about what might be happening here, I'd be more than happy to pay for a genuine expert to take a look. If anyone has any potential ideas, I'd love to reward you with a 'good answer'.Many, many thanks in advance.
Ryan.
-
-
Hi Monica,
Thanks for the fast response.
I'm a bit wary of 301 redirecting the old pages -- this would be extremely easy to do - however: if we were being penalised on those old pages, wouldn't this just redirect all the penalties to our new squeaky clean pages?
I submitted a new sitemap to Google the day we made the changes -- probably about three weeks - a month ago including the new URLs (or as many as we could include with the 500 URL limit) and removing the old spammy ones.
Penalty-wise, we've never had a manual warning or anything in WMT. However, this doesn't discount the idea that we may have been suffering an algorithm penalty, right?
It'd be great to hear from anyone about their experience with 301's and the likeliness of passing on 'bad' linkjuice from old pages (does this even happen?).
Also whether a 410 would help - stops all the 404 errors from continuously occurring and Google assuming there's something bizarre going on.Thank you again.
-
How do we drive traffic: In light of removing these old pages, and seeing a tremendous influx of 404 errors, I am assuming the pages that were removed were not 301 redirected. If that is the case I would strongly encourage you to redirect those old URLs to your new pages. This will help get traffic to the new pages which will eventually help them rank on their own. It sounds like your pages just dropped off the face of the planet and because the other pages are so new, you are losing all of your organic rankings and subsequently, organic traffic.
How long should you wait to be indexed: Did you submit a new sitemap to Google? I would make sure you have done that. After that, it shouldn't take very long, 2 weeks is the longest I have waited for an index after a sitemap submission.
As far as a penalty goes, check WMT. If you see nothing in there from Google I think you are safe on the penalty side. However, the sudden changes, the large amount of changes and the influx in 404 pages might have moved your site back in rankings while Google takes a look to make sure there isn't any nefarious activity. I wouldn't worry about a penalty unless you actually receive one.
If you are worried about duplicate content, try researching Rel canonical tags to see if they will be helpful to you. It sounds like you made a lot of changes quickly, and that Google needs time to investigate. Unfortunately, you have to kind of wait a little bit. Try the things I listed here, I hope that it helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does ID's in URL is good for SEO? Will SEO Submissions sites allow such urls submissions?
Example url: http://public.beta.travelyaari.com/vrl-travels-13555-online It's our sites beta URL, We are going to implement it for our site. After implementation, it will be live on travelyaari.com like this - "https://www.travelyaari.com/vrl-travels-13555-online". We have added the keywords etc in the URL "VRL Travels". But the problems is, there are multiple VRL travels available, so we made it unique with a unique id in URL - "13555". So that we can exactly get to know which VRL Travels and it is also a solution for url duplication. Also from users / SEO point of view, the url has readable texts/keywords - "vrl travels online". Can some Moz experts suggest me whether it will affect SEO performance in any manner? SEO Submissions sites will accept this URL? Meanwhile, I had tried submitting this URL to Reddit etc. It got accepted.
White Hat / Black Hat SEO | | RobinJA0 -
Sudden shift in rankings?
What would make a website move from position 14-17 (for the last year or so) to position 1 for a very competitive keyword when there are no obvious site changes?
White Hat / Black Hat SEO | | OUTsurance1 -
Infinite Scrolling on Publisher Sites - is VentureBeat's implementation really SEO-friendly?
I've just begun a new project auditing the site of a news publisher. In order to increase pageviews and thus increase advertising revenue, at some point in the past they implemented something so that as many as 5 different articles load per article page. All articles are loaded at the same time and from looking in Google's cache and the errors flagged up in Search Console, Google treats it as one big mass of content, not separate pages. Another thing to note is that when a user scrolls down, the URL does in fact change when you get to the next article. My initial thought was to remove this functionality and just load one article per page. However I happened to notice that VentureBeat.com uses something similar. They use infinite scrolling so that the other articles on the page (in a 'feed' style) only load when a user scrolls to the bottom of the first article. I checked Google's cached versions of the pages and it seems that Google also only reads the first article which seems like an ideal solution. This obviously has the benefit of additionally speeding up loading time of the page too. My question is, is VentureBeat's implementation actually that SEO-friendly or not. VentureBeat have 'sort of' followed Google's guidelines with regards to how to implement infinite scrolling https://webmasters.googleblog.com/2014/02/infinite-scroll-search-friendly.html by using prev and next tags for pagination https://support.google.com/webmasters/answer/1663744?hl=en. However isn't the point of pagination to list multiple pages in a series (i.e. page 2, page 3, page 4 etc.) rather than just other related articles? Here's an example - http://venturebeat.com/2016/11/11/facebooks-cto-explains-social-networks-10-year-mission-global-connectivity-ai-vr/ Would be interesting to know if someone has dealt with this first-hand or just has an opinion. Thanks in advance! Daniel
White Hat / Black Hat SEO | | Daniel_Morgan1 -
What are legit ways to raise up you're ranking for a new website?
I have a wallpaper website that i just made and bought a template that looks fine for the site so far for a month now, and i wanted to know what steps i cant take to better rank my site and build some traffic along the way. I use only specific directories, not sure how to get a press release done and also link back to other sites from pages that get a decent amount of traffic where i can leave a link to it, of course not leaving any type of spammy looking comments. This is the site i am working on right now, freehdwallpapers.be I have linked back from a few sites already, i look at the alexa rank if it will show a number at one point, the sites worth is still pretty low, and also i have added social networks on the site which has gained a number of followers to this day, so i got work to do still. I just don't want to go on about it the wrong way and get penalized by google.
White Hat / Black Hat SEO | | 1080HDWallpapers0 -
Sudden Drop in Keyword Ranking - No Idea Why
Hi Mozzers, I am in charge of everything Web Optimization for the company I work for. I keep active track of our SEO/SEM practices, especially our keyword rankings. Prior to my arrival at the company, in January of this year, we had a consultant handling the SEO work and though they did a decent job on maintaining our rankings for a hefty set of keywords, they were unable to get a particular competitive keyword ranking. This is odd because other derivations of that keyword which are equally competitive are all still ranking on page one. Also, full disclosure, they were not engaging in any questionable linking. In fact, they didn't do much of any link building whatsoever. I also haven't been engaging in any questionable content creation or spammy linking. We put out content regularly as we are a publicly traded company - nothing spammy at all. Anyway, one thing I tried since February was engaging in a social media sharing campaign among friends and coworkers to share the respective page and keyword on their Facebook and Google+ pages. To my surprise, this tactic worked just like natural search usually does - slowly and through the months I saw the keyword rank from completely invisible, to page 6, to page 3, to page 2, and finally onto position 6 page one as of just last week. Today, unfortunately, the keyword is invisible again :(. I am perplexed. It's tough to build links for our company as we are in the public and everything we do has to be approved by someone higher up. I also checked our webmaster tools and haven't seen any notifications that can give me clue as to what's going on. I am aware that there was a Penguin update recently and there are monthly Panda updates, but I'm skeptical as to whether or not those updates would be correlated to this because, at initial glance, our traffic and rankings for other keywords and pages don't seem to be affected. Suggestions? Advice? Answers? Thanks!
White Hat / Black Hat SEO | | CSawatzky0 -
I'm worried my client is asking me to post duplicate content, am I just being paranoid?
Hi SEOMozzers, I'm building a website for a client that provides photo galleries for travel destinations. As of right now, the website is basically a collection of photo galleries. My client believes Google might like us a bit more if we had more "text" content. So my client has been sending me content that is provided free by tourism organizations (tourism organizations will often provide free "one-pagers" about their destination for media). My concern is that if this content is free, it seems likely that other people have already posted it somewhere on the web. I'm worried Google could penalize us for posting content that is already existent. I know that conventionally, there are ways around this-- you can tell crawlers that this content shouldn't be crawled-- but in my case, we are specifically trying to produce crawl-able content. Do you think I should advise my client to hire some bloggers to produce the content or am I just being paranoid? Thanks everyone. This is my first post to the Moz community 🙂
White Hat / Black Hat SEO | | steve_benjamins0 -
Anchor text penalty doesn't work?!
How do you think, does the anchortext penalty exactly work? Keyword domains obviously can't over-optimize for their main keyword (for example notebook.com for the keyword notebook). And a lot of non-keyword-domains do optimize especially in the beginning for their main keyword to get a good ranking in google (and it always works). Is there any particular point (number of links) I can reach, optimizing for one keyword, after what i'm gonna get a penalty?
White Hat / Black Hat SEO | | TheLastSeo0 -
Sudden drop in rakings for a keyword.
Hi, A few weeks ago my homepage - http://www.linearsky.com dropped out of the rankings completely for a keyword I was promoting (web design staffordshire). I was thinking that one of the reasons could be a sudden link spike. The reason being is that I have been doing some development work (for a client) on one of my sub-domains. Now this is a Magento site with thousands of products, with my keyword rich link in the footer. From looking at the Google webmaster tools, it seams that alot of these pages got indexed accidently. Could this sudden link spike be enough to be penalised by Google? Apart from that the only borderline black hat stuff I have been doing is some reciprocal link swapping with a few websites in my niche - http://www.linearsky.com/misc/links.html I also bought a paid link on http://www.iwebtool.com/browser_details, (that I have now asked to be withdrawn) to see what kind of boost it would give me. I know this is unethical, but a number of page one competitors were also using this said link. Also it was only indexed for a few weeks. Could Google really pick this up so quickly? Any ideas of how to resolve this? Many Thanks Marcus
White Hat / Black Hat SEO | | marcusuk-3041050