Puzzling Penalty Question - Need Expert Help
-
I'm turning to the Moz Community because we're completely stumped. I actually work at a digital agency, our specialism being SEO. We've dealt with Google penalties before and have always found it fairly easy to identify the source the problem when someone comes to us with a sudden keyword/traffic drop.
I'll briefly outline what we've experienced:
We took on a client looking for SEO a few months ago. They had an OK site, with a small but high quality and natural link profile, but very little organic visibility. The client is an IT consultancy based in London, so there's a lot of competition for their keywords. All technical issues on the site were addressed, pages were carefully keyword targeted (obviously not in a spammy way) and on-site content, such as services pages, which were quite thin, were enriched with more user focused content. Interesting, shareable content was starting to be created and some basic outreach work had started.
Things were starting to pick up. The site started showing and growing for some very relevant keywords in Google, a good range and at different levels (mostly sitting around page 3-4) depending on competition. Local keywords, particularly, were doing well, with a good number sitting on page 1-2. The keywords were starting to deliver a gentle stream of relevant traffic and user behaviour on-site looked good.
Then, as of the 28th September 2015, it all went wrong. Our client's site virtually dropped from existence as far as Google was concerned. They literally lost all of their keywords. Our client even dropped hundreds of places for their own brand name. They also lost all rankings for super low competition, non-business terms they were ranking for.
So, there's the problem. The keywords have not shown any sign of recovery at all yet and we're, understandably, panicking. The worst thing is that we can't identify what has caused this catastrophic drop. It looks like a Google penalty, but there's nothing we can find that would cause it. There are no messages or warnings in GWT. The link profile is small but high quality. When we started the content was a bit on the thin side, but this doesn't really look like a Panda penalty, and seems far too severe. The site is technically sound. There is no duplicate content issues or plaigarised content. The site is being indexed fine. Moz gives the site a spam score of 1 (our of 11 (i think that's right)). The site is on an ok server, which hasn't been blacklisted or anything.
We've tried everything we can to identify a problem. And that's where you guys come in. Any ideas? Anyone seen anything similar around the same time? Unfortunately, we can't share our clients' site's name/URL, but feel free to ask any questions you want and we'll do our best to provide info.
-
Thanks again Marie!
You've been really helpful, and it's much appreciated. Unfortunately, we've still not found anything that could cause the issue. That thread shared was really interesting, but their problems was quite different to ours. They lost traffic immediately after moving their hosting, whereas our client lost traffic 2-3 weeks after moving server. I'm still not ruling out the possibility that this could've been the catalyst that set off the big drop. We're stumped; but still dedicating time into solving this issue.
I'd love to drop the client's URL in here but I'm sure they wouldn't appreciate us sharing it in this way. The only alternative would be to DM it to someone who knew what they were talking about.
-
Also...if it helps, I found this thread very interesting when it comes to troubleshooting big drops following a server change:
-
If you've recently moved to a new server, has the page load time been affected much? Do you see anything on a DNS check such as here:
I understand the hesitance in adding a clients' url. I would likely only do so with the clients' permission.
One final thought - I had said that there were no major algo shifts that I was aware of on September 28, but then Alan Bleweiss tweeted about a client who saw a big jump up on that day:
https://twitter.com/AlanBleiweiss/status/656201424439746560
He had wondered if it was a Panda related change.
Yesterday I finally saw one of my clients make a big jump up in what appears to be a Panda recovery. We may be moving to the point where we can't pin down Panda hits and recoveries to just one day. I'm not saying it's Panda for sure though. To drop to the degree that you have and not even have the brand ranking at all you'd have to have really really significant Panda issues.
-
Hi Maria
Thank you very much for the detailed suggestions. The site doesn't use AJAX much/at all, but I'd missed this piece of news, so thank you.
You've kind of echoed our conclusions, but we're still no closer to a solution. The only thing we have done recently is move the client onto a new server. Can you think of any reason that this might have caused our issues? We've checked the server isn't blacklisted or anything obvious like that.
We're a bit reticent to share a clients' URL on here. From your experience, are the community respectful of this information? The last thing we want is our client being cold called after someone has found there URL here!
-
Hi Andrew
Thanks for the help. Reassuring to hear we're not alone! We'll be sure to check the recommended tool!
-
Hi Tom
Thank you very much for the advice. We've ruled out points 1) & 3). We've had nothing in GWT. We've used several tools to check our link profile, including Ahrefs, looking in-depth at all aspects of the profile.
We've been pretty darn thorough with our checks, but there remains a small chance the site could've been hacked and we've not yet picked up on this. Malicious digital activity changes all the time, so I suppose this could be a result of something we've not seen before (though it's unlikely). Have you got any tips for identifying such activity (apart from the obvious (eg. inbound/outbound links)?
-
What a frustrating situation.
Does the site rely on AJAX much? In late September, early October a lot of sites that relied on AJAX saw their sites drop out of search. It was first noticed with WIX sites, but many other sites had the same issue:
https://www.seroundtable.com/wix-google-deindex-21034.html
There was no major shakeup of Panda/Penguin in late September. It's possible that there were some small Panda ripples but I haven't seen any cases of sites plummeting in search because of Panda recently.
I echo the advice to check for hacked pages.
I'd also have a good look for things like a change in design, url structure, etc. I've seen quite a few sites who somehow accidentally noindexed half their site by backing up legacy code or making a similar error. I'd also re-evaluate your robots.txt page and do some fetch and render as Googlebot on the pages that aren't ranking well to see if you can see obvious issues.
With a big drop like this my money would be on a technical error in the site. It really doesn't sound like a Penguin/Panda problem to me. That said, if none of these tips help, sharing the url in this forum will get you some more specific advice.
-
We had a similar thing happen with a client a while ago and it was to do with point 3 as mentioned by Tom, it turned out that the site had been hacked and had some very adverse and unwanted links added to the footer that were invisible to the naked eye or by searching the code.
We were recommended a little plugin for chrome called User Agent Switcher which identified and revealed these hidden links on the site, once they were dealt with the site recovered to where it was previously.
-
Hi Adam
First of all - very sorry to see this. Hope you can get them back on their feet.
For something so dramatic, for me it's only ever one of three things:
-
A manual penalty (as notified in GWT)
-
Website has been hacked
-
A penguin penalty
I think with points 1 and 2, you might have already ruled this out, but be absolutely sure. Run every check under the sun to see whether the site was compromised, look for odd URLs that have been created, check Joomla/WP updates (and plugin updates to make sure they're not injecting malicious code) - just anything.
So that leaves us with point 3 - and I know you've mentioned you've looked at the backlinks already, and apologies in advance if this advice is like teaching you to suck eggs. Have you tried every backlink source, not just Moz, but WMT, Majestic and Ahrefs? Have you used tools like Kerboo and URLProfiler for quick classification of the sites? Have you checked the anchor text distribution?
The big calling card for me is the brand name drop - and that the majority of the time relates to a link/spam penalty. If you want, you can PM me the URL and I'll quickly pop it into Majestic and Ahrefs for a bit of further analysis - if anything just for a bit of sense checking.
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Need Advice - Google Still Not Ranking
Hi Team - I really need some expert level advice on an issue I'm seeing with our site in Google. Here's the current status. We launched our website and app on the last week of November in 2014 (soft launch): http://goo.gl/Wnrqrq When we launched we were not showing up for any targeted keywords, long tailed included, even the title of our site in quotes. We ranked for our name only, and even that wasn't #1. Over time we were able to build up some rankings, although they were very low (120 - 140). Yesterday, we're back to not ranking for any keywords. Here's the history: While developing our app, and before I took over the site, the developer used a thin affiliate site to gather data and run a beta app over the course of 1 - 2 years. Upon taking on the site and moving to launch the new website/app I discovered what had been run under the domain. Since than the old site has been completely removed and rebuild, with all associated urls (.uk, .net, etc...) and subdomains shutdown. I've allowed all the old spammy pages (thousands of them to 404). We've disavowed the old domains (.net, .uk that were sending a ton of links to this), along with some links that seemed a little spammy that were pointing to our domain. There are no manual actions or messaged in Google Webmaster Tools. The new website uses (SSL) https for the entire site, it scores a 98 / 100 for a mobile usability (we beat our competitors on Google's PageSpeed Tool), it has been moved to a business level hosting service, 301's are correctly setup, added terms and conditions, have all our social profiles linked, linked WMT/Analytics/YouTube, started some Adwords, use rel="canonical", all the SEO 101 stuff ++. When I run the page through the moz tool for a specific keyword we score an A. When I did a crawl test everything came back looking good. We also pass using other tools. Google WMT, shows no html issues. We rank well on Bing, Yahoo and DuckDuckGo. However, for some reason Google will not rank the site, and since there is no manual action I have no course of action to submit a reconsideration request. From an advanced stance, should we bail on this domain, and move to the .co domain (that we own, but hasn't been used before)? If we 301 this domain over, since all our marketing is pointed to .com will this issue follow us? I see a lot of conflicting information on algorithmic issues following domains. Some say they do, some say they don't, some say they do since a lot of times people don't fix the issue. However, this is a brand new site, and we're following all of Google's rules. I suspect there is an algorithmic penalty (action) against the domain because of the old thin affiliate site that was used for the beta and data gathering app. Are we stuck till Google does an update? What's the deal with moving us up, than removing again? Thoughts, suggestions??? I purposely, did a short url to leave out the company name, please respect that, since I don't want our issues to popup on a web search. 🙂
Algorithm Updates | | get4it0 -
Dumb International SEO question?
Buongiorno from 18 degrees C Wetherby UK... Client asks - "My swedish site is http://www2.kingspanpanels.se/ how important is having the swedish suffix in the url with regards to rankings in Sweden?" I find these questions really challenging, its like the Hey if i change this url my SEO problems will be fixed, as if its that easy. So my question is - "How weighted is the url suffix / ccTLD in terms of SEO success for a territory / country" Put another way "If the swedish suffix .se was removed would it impact rankings in any way in Sweden?" Grazie tanto,
Algorithm Updates | | Nightwing
David0 -
Struggling with Google Bot Blocks - Please help!
I own a site called www.wheretobuybeauty.com.au After months and months we still have a serious issue with all pages having blocked URLs according to Google Webmaster Tools. The 404 errors are returning a 200 header code according to the email below. Do you agree that the 404.php code should be changed? Can you do that please ? The current state: Google webmaster tools Index Status shows: 26,000 pages indexed 44,000 pages blocked by robots. In late March, we implemented a change recommended by an SEO expert and he provided a new robots.txt file, advised that we should amend sitemap.xml and other changes. We implemented those changes and then setup a re-index of the site by google. The no of blocked URLs eventually reduced in May and June to 1,000 for a few days – but now the problem has rapidly returned. The no of pages that are displayed in a google search request of www.google.com.au where the query was ‘site:wheretobuybeauty.com.au’ is 37,000: This new site has been re-crawled over last 4 weeks. About the site This is a Linux php site and has the following: 55,000 URLs in sitemap.xml submitted successfully to webmaster tools robots.txt file has been modified several times: Firstly we had none Then we created one but were advised that it needed to have this current content: User-agent: * Disallow: Sitemap: http://www.wheretobuybeauty.com.au/sitemap.xml
Algorithm Updates | | socialgrowth0 -
Penalty for Mixing Microdata with Metadata
The folks that built our website have insisted on including microdata and metadata on our pages. What we end up with is something that looks like this in the header: itemprop="description" content="Come buy your shoes from us, we've got great shoes."> Seems to me that this would be a bad thing, however I can't find any info leaning one way or the other. Can anyone provide insight on this?
Algorithm Updates | | markcely0 -
How does my blog help in SEO
Hi I have recently put a wordpress blog on my site and have employed a few blog writers, each putting 2 or 3 posts per week up. There brief so far has been to write interesting, humorous and topical articles. Stupid as it may seem I have done this only because the general consensus seemed to be "you must have a blog for SEO" Does it help? Assuming it does: Should I post the same articles to my facebook page and or anywhere else? Should the articles have anchor text linking back to my site? What should I do to make it work well? Thanks in advance Andy
Algorithm Updates | | First-VehicleLeasing1 -
Forum software penalties
I'm hoping to solicit some feedback on what people feel would be SEO best practices for message board/forum software. Specifically, while message boards that are healthy can generate tons of unique content, they also can generate a fair share of thin content pages. These pages include... Calendar pages that can have a page for each day of each month for 10 years! (thats like 3650 pages of just links). User Profile pages, which depending on your setup can tend to be thin. The board I work with has 20k registered members, hence 20k user profile pages. User lists which can have several hundred pages. I believe Google is pretty good at understanding what is message board content, but there is still a good chance that one could be penalized for these harmless pages. Do people feel that the above pages should be noindexed? Another issue is that of unrelated content. Many forums have their off-topic areas (the Pub or Hangout or whatever). On our forum up to 40% of the content is off-topic (when I say content I mean number of post versus raw word count). What are the advantages and disadvantages of such content? On one hand they expand the keywords you can rank for. On the other hand it might generate google organic traffic which you might now want because of a high bounce rate. Does too much indexable content that is unique dilute your good content?
Algorithm Updates | | entropytc1 -
Addicted to SEO: Please Help!
Hello. My name is Justin. And I am an addict. I have recently starting dabbling around with SEO about five months ago. And I have found myself wanting more and more. I feel like I needed to come to this group of other addicts and admit it to you. I am constantly checking my ranking in Google. I am obsessed with my keywords. And I will sell my soul for a PR8 in-bound link. I desperately want my site: www.findahealthcarejob.com to be the best in the universe and it has been a wonderful drug for me. This must stop. Please help me. What are some steps of your own 12-steps that help you detox from this addicting lifestyle? Thank you.
Algorithm Updates | | findachristianjob0 -
301 redirect question
So I have an employer who owns a retail site and his category URLs are horrible. So, I am suggesting to him to create a new page with a pretty URL and 301 redirect the old page to the new page. I am suggesting this to him, because this will help increase CTR for the targeted keyword & help him rank higher for the term. He is apprehensive about this cause he thinks this will cause him to drop in ranking. Does anybody know any resources or have any past experiences that will back up my suggestion or his for that matter?
Algorithm Updates | | Cyle0