Puzzling Penalty Question - Need Expert Help
-
I'm turning to the Moz Community because we're completely stumped. I actually work at a digital agency, our specialism being SEO. We've dealt with Google penalties before and have always found it fairly easy to identify the source the problem when someone comes to us with a sudden keyword/traffic drop.
I'll briefly outline what we've experienced:
We took on a client looking for SEO a few months ago. They had an OK site, with a small but high quality and natural link profile, but very little organic visibility. The client is an IT consultancy based in London, so there's a lot of competition for their keywords. All technical issues on the site were addressed, pages were carefully keyword targeted (obviously not in a spammy way) and on-site content, such as services pages, which were quite thin, were enriched with more user focused content. Interesting, shareable content was starting to be created and some basic outreach work had started.
Things were starting to pick up. The site started showing and growing for some very relevant keywords in Google, a good range and at different levels (mostly sitting around page 3-4) depending on competition. Local keywords, particularly, were doing well, with a good number sitting on page 1-2. The keywords were starting to deliver a gentle stream of relevant traffic and user behaviour on-site looked good.
Then, as of the 28th September 2015, it all went wrong. Our client's site virtually dropped from existence as far as Google was concerned. They literally lost all of their keywords. Our client even dropped hundreds of places for their own brand name. They also lost all rankings for super low competition, non-business terms they were ranking for.
So, there's the problem. The keywords have not shown any sign of recovery at all yet and we're, understandably, panicking. The worst thing is that we can't identify what has caused this catastrophic drop. It looks like a Google penalty, but there's nothing we can find that would cause it. There are no messages or warnings in GWT. The link profile is small but high quality. When we started the content was a bit on the thin side, but this doesn't really look like a Panda penalty, and seems far too severe. The site is technically sound. There is no duplicate content issues or plaigarised content. The site is being indexed fine. Moz gives the site a spam score of 1 (our of 11 (i think that's right)). The site is on an ok server, which hasn't been blacklisted or anything.
We've tried everything we can to identify a problem. And that's where you guys come in. Any ideas? Anyone seen anything similar around the same time? Unfortunately, we can't share our clients' site's name/URL, but feel free to ask any questions you want and we'll do our best to provide info.
-
Thanks again Marie!
You've been really helpful, and it's much appreciated. Unfortunately, we've still not found anything that could cause the issue. That thread shared was really interesting, but their problems was quite different to ours. They lost traffic immediately after moving their hosting, whereas our client lost traffic 2-3 weeks after moving server. I'm still not ruling out the possibility that this could've been the catalyst that set off the big drop. We're stumped; but still dedicating time into solving this issue.
I'd love to drop the client's URL in here but I'm sure they wouldn't appreciate us sharing it in this way. The only alternative would be to DM it to someone who knew what they were talking about.
-
Also...if it helps, I found this thread very interesting when it comes to troubleshooting big drops following a server change:
-
If you've recently moved to a new server, has the page load time been affected much? Do you see anything on a DNS check such as here:
I understand the hesitance in adding a clients' url. I would likely only do so with the clients' permission.
One final thought - I had said that there were no major algo shifts that I was aware of on September 28, but then Alan Bleweiss tweeted about a client who saw a big jump up on that day:
https://twitter.com/AlanBleiweiss/status/656201424439746560
He had wondered if it was a Panda related change.
Yesterday I finally saw one of my clients make a big jump up in what appears to be a Panda recovery. We may be moving to the point where we can't pin down Panda hits and recoveries to just one day. I'm not saying it's Panda for sure though. To drop to the degree that you have and not even have the brand ranking at all you'd have to have really really significant Panda issues.
-
Hi Maria
Thank you very much for the detailed suggestions. The site doesn't use AJAX much/at all, but I'd missed this piece of news, so thank you.
You've kind of echoed our conclusions, but we're still no closer to a solution. The only thing we have done recently is move the client onto a new server. Can you think of any reason that this might have caused our issues? We've checked the server isn't blacklisted or anything obvious like that.
We're a bit reticent to share a clients' URL on here. From your experience, are the community respectful of this information? The last thing we want is our client being cold called after someone has found there URL here!
-
Hi Andrew
Thanks for the help. Reassuring to hear we're not alone! We'll be sure to check the recommended tool!
-
Hi Tom
Thank you very much for the advice. We've ruled out points 1) & 3). We've had nothing in GWT. We've used several tools to check our link profile, including Ahrefs, looking in-depth at all aspects of the profile.
We've been pretty darn thorough with our checks, but there remains a small chance the site could've been hacked and we've not yet picked up on this. Malicious digital activity changes all the time, so I suppose this could be a result of something we've not seen before (though it's unlikely). Have you got any tips for identifying such activity (apart from the obvious (eg. inbound/outbound links)?
-
What a frustrating situation.
Does the site rely on AJAX much? In late September, early October a lot of sites that relied on AJAX saw their sites drop out of search. It was first noticed with WIX sites, but many other sites had the same issue:
https://www.seroundtable.com/wix-google-deindex-21034.html
There was no major shakeup of Panda/Penguin in late September. It's possible that there were some small Panda ripples but I haven't seen any cases of sites plummeting in search because of Panda recently.
I echo the advice to check for hacked pages.
I'd also have a good look for things like a change in design, url structure, etc. I've seen quite a few sites who somehow accidentally noindexed half their site by backing up legacy code or making a similar error. I'd also re-evaluate your robots.txt page and do some fetch and render as Googlebot on the pages that aren't ranking well to see if you can see obvious issues.
With a big drop like this my money would be on a technical error in the site. It really doesn't sound like a Penguin/Panda problem to me. That said, if none of these tips help, sharing the url in this forum will get you some more specific advice.
-
We had a similar thing happen with a client a while ago and it was to do with point 3 as mentioned by Tom, it turned out that the site had been hacked and had some very adverse and unwanted links added to the footer that were invisible to the naked eye or by searching the code.
We were recommended a little plugin for chrome called User Agent Switcher which identified and revealed these hidden links on the site, once they were dealt with the site recovered to where it was previously.
-
Hi Adam
First of all - very sorry to see this. Hope you can get them back on their feet.
For something so dramatic, for me it's only ever one of three things:
-
A manual penalty (as notified in GWT)
-
Website has been hacked
-
A penguin penalty
I think with points 1 and 2, you might have already ruled this out, but be absolutely sure. Run every check under the sun to see whether the site was compromised, look for odd URLs that have been created, check Joomla/WP updates (and plugin updates to make sure they're not injecting malicious code) - just anything.
So that leaves us with point 3 - and I know you've mentioned you've looked at the backlinks already, and apologies in advance if this advice is like teaching you to suck eggs. Have you tried every backlink source, not just Moz, but WMT, Majestic and Ahrefs? Have you used tools like Kerboo and URLProfiler for quick classification of the sites? Have you checked the anchor text distribution?
The big calling card for me is the brand name drop - and that the majority of the time relates to a link/spam penalty. If you want, you can PM me the URL and I'll quickly pop it into Majestic and Ahrefs for a bit of further analysis - if anything just for a bit of sense checking.
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO Myth-Busters -- Isn't there a "duplicate content" penalty by another name here?
Where is that guy with the mustache in the funny hat and the geek when you truly need them? So SEL (SearchEngineLand) said recently that there's no such thing as "duplicate content" penalties. http://searchengineland.com/myth-duplicate-content-penalty-259657 by the way, I'd love to get Rand or Eric or others Mozzers aka TAGFEE'ers to weigh in here on this if possible. The reason for this question is to double check a possible 'duplicate content" type penalty (possibly by another name?) that might accrue in the following situation. 1 - Assume a domain has a 30 Domain Authority (per OSE) 2 - The site on the current domain has about 100 pages - all hand coded. Things do very well in SEO because we designed it to do so.... The site is about 6 years in the current incarnation, with a very simple e-commerce cart (again basically hand coded). I will not name the site for obvious reasons. 3 - Business is good. We're upgrading to a new CMS. (hooray!) In doing so we are implementing categories and faceted search (with plans to try to keep the site to under 100 new "pages" using a combination of rel canonical and noindex. I will also not name the CMS for obvious reasons. In simple terms, as the site is built out and launched in the next 60 - 90 days, and assume we have 500 products and 100 categories, that yields at least 50,000 pages - and with other aspects of the faceted search, it could create easily 10X that many pages. 4 - in ScreamingFrog tests of the DEV site, it is quite evident that there are many tens of thousands of unique urls that are basically the textbook illustration of a duplicate content nightmare. ScreamingFrog has also been known to crash while spidering, and we've discovered thousands of URLS of live sites using the same CMS. There is no question that spiders are somehow triggering some sort of infinite page generation - and we can see that both on our DEV site as well as out in the wild (in Google's Supplemental Index). 5 - Since there is no "duplicate content penalty" and there never was - are there other risks here that are caused by infinite page generation?? Like burning up a theoretical "crawl budget" or having the bots miss pages or other negative consequences? 6 - Is it also possible that bumping a site that ranks well for 100 pages up to 10,000 pages or more might very well have a linkuice penalty as a result of all this (honest but inadvertent) duplicate content? In otherwords, is inbound linkjuice and ranking power essentially divided by the number of pages on a site? Sure, it may be some what mediated by internal page linkjuice, but what's are the actual big-dog issues here? So has SEL's "duplicate content myth" truly been myth-busted in this particular situation? ??? Thanks a million! 200.gif#12
Algorithm Updates | | seo_plus0 -
Ecommerce SEO help
Hi I'm having difficulty managing our product pages for optimisation, we have over 20,000 products. We do keyword research & optimise product titles/meta of new products - however there's a lot to clean up but we have done a lot. I find we rank/convert better on product pages so they would be great to focus on - however when an old product is discontinued, the page is removed & we lose authority by creating new pages for similar products - does anyone have any ideas for managing this? This is something done automatically on the dev side in France. I then have the issue of trying to rank category pages - these are highly competitive areas competing with big brands. I'm finding it tough to know where to focus, the site is vast and I am the only SEO. I've started looking into low hanging fruit - but these aren't necessarily the areas which bring in much revenue. Thanks!
Algorithm Updates | | BeckyKey0 -
Question: About Google's personalization of search results and its impact on monitoring ranking results
Given Google's personalization of search results for anyone who's logged into a Google property, how realistic and how actually meaningful/worthwhile is it to monitor one's ranking results for any keyword term these days?
Algorithm Updates | | RandallScrubs0 -
How can a site with two questionable inbound links outperform sites with 500-1000 links good PR?
Our site for years was performing at #1 for but in the last 6 months been pushed down to about the #5 spot. Some of the domains above us have a handful of links and they aren't from good sources. We don't have a Google penalty. We try to only have links from quality domains but have been pushed down the SERP's? Any suggestions?
Algorithm Updates | | northerncs0 -
Google Site Links question
Are Google site links only ever shown on the top website? Or is it possible for certain queries for the site in position #2 or #3 or something to have site links but the #1 position not have them? If there are any guides, tips or write ups regarding site links and their behavior and optimization please share! Thanks.
Algorithm Updates | | IrvCo_Interactive0 -
Puzzled by recent SERP results - what ranking factors cause this?
Hi mozzers, I have been using moz tools for a long while now for assessing SEO metrics with great success, but since recent Google algorithm updates I am seeing more and more SERPS that just simply don't make sense to me what so ever. The most startling recently was an assessment of one of the keywords my own site competes for "Link Building Services" The current No 1 position in Google.co.uk is held by http://www.napalit.org/ I invite all you seo experts out there to take a look at this site, look at it metrics in OSE compared with the "lower" competition and explain to me why it is No1. I would really like to know what ranking factors this site has that makes it "higher quality" and offer "better value" than the competition. I thought I understood what Google was trying to do with recent updates - get rid of non-value adding spammers and improve the quality of the search results. But now I am becoming more sceptical. Are they just making it impossible for us to make a difference by following good SEO practices so we all resort to paying for Adwords? I hope you guys out there can help me with this one and restore my faith. Thanks
Algorithm Updates | | websearchseo0 -
Domain Name History Question
Hi, When launching a new domain, do you think Google holds these back in the rankings for a certain time period? I have noticed with a few, the rankings are held back for a few months (10 page deep results when the site's first indexed and ranked), then almost like a switch rankings start to come through pretty aggressively in some cases. For example: a result could be on page 16 for a month or so, then all of a sudden jump through to page 6 (with no link building or site update), at this point the result would stay steady and would need work to push through. Anyone else get this, or does anyone have any insight about domain history and Google. Cheers
Algorithm Updates | | activitysuper0 -
Help with local Seo?
Hi, I am really struggling with current predicament i find myself in. I am a small to medium sized business based in Newcastle in the UK and am trying to rank well locally for the keywords that i feel my customers will be searching for locally. I have got to the stage where i am on page 1 of google uk or nearly there but cannot compete against the national companies who have the search terms then just add pages for virtually every city in the country. For example my main product is "Artificial Grass" and my city/town is Newcastle This is where my office is and where my customers are. This is also where my google places page states. Now theres a company that sells Artificial Grass called www.asgoodasgrass.co.uk that are based no where near but use the power of there site to come up in every local search by adding a page "Artificial Grass Newcastle" as well as hundreds of others. They rank 3rd and im 8th. There actual Newcastle page is poor, where as i put everything into my page including pics, video etc. Still no joy. I feel i am always going to rank behind these big boys even though i am the actual local company and have no intention of working others area that are not local to me. By the time i rank behind the above type companies and the likes of yell.com i feel i am never going to be seen and fall back on expensive adwords to help me along. I am a complete newbie at this and would love any help or tips you could give to give me a fighting chance in my area. My site is www.totaldrivewaysne.co.uk incase you want to look as you will have gathered my other primary product is driveways for which also i feel like i have a million competitors! many many thanks for any responses John
Algorithm Updates | | totaldriveways0