Guides to determine if a client's website has been penalized?
-
Has anyone come across any great guides to pair with client data to help you determine if their website has been penalized?
I'm also not talking about an obvious drop in traffic/rankings, but I want to know if there's a guide out there for detecting the subtleties that may be found in a client's website data. One that also helps you take into account all the different variables that may not be related to the engines.
Thanks!
-
Good point about the Change History - at least that will catch things like new filters.
Understood about the external doc being easier for some clients not used to working in Analytics. When going that route, I at lease try to get them working in a shared document - either in Google Docs or at least a shared doc in a DropBox or something.
That way there are fewer issues with trying to figure out who has the most current version, and it's available to you when you need it - like when you are doing a normal monthly review but want to quickly check what you think might be an anomaly - without having to make a request for the doc.
P.
-
Thanks Paul. Maybe now that Analytics will be showing change history that will also save time too.
I like your idea about an external document. That seems more approachable than having our clients who are not so comfortable make their annotations in Google Analytics.
-
Glad it was helpful, Ellen, and thanks for the kind words.
And you've hit exactly the challenge so many of us encounter with clients - we're just not kept in the loop of all the things they're doing. (and this critically includes changes to site code and analytics as I mentioned, not just marketing efforts) The only effective way I've found is to make the client responsible for enforcing that their devs and marketers keep the annotations (or if necessary some external file, blech) up to date.
Otherwise you can easily waste hours chasing an issue, only to later find out someone goofed up changing a filter in analytics, for example. Not that that has ever happened to me
That's how I pitch this to clients - either work out a way to make certain it's kept up to date on an ongoing basis, or risk having to pay me for many hours of extra work every time I'm asked to try to track down an issue or to assess overall traffic health. Or maybe even waste big money with a wrong diagnosis because not enough info was provided.
More and more, effective analysis needs to take into account many more cross-channel aspects. The only way to do this effectively is to have those cross-channel efforts recorded in some way right in the Analytics.
Good luck!
Paul
-
It's definitely not a helluva lot to throw at me, but instead is exactly the sort of thing I was looking for! Thank you so much Paul for such a thorough answer. This is definitely the direction I've been moving toward.
The most difficult thing with my clients is there are so many hands in the pot, and they often don't let us know what's going on with their external marketing efforts. Additionally, some of our clients have multiple marketing agencies making changes to their websites, and there are multiple admins on the Analytics.
Holding the client responsible for the updates is a great idea, and it would just take a lot more prodding on our end.
This discussion was spurred by a client that saw a major decline in non-paid search traffic (Google only) over the last quarter of 2012. There were no penalties in GWT, so this leads me to believe as you said it was an algo update. I'm going to use your tips to try and further isolate the affected areas.
I really appreciate the time you took to answer my question. Thanks again.
-
Ellen, there are just far too many reasons why a site's traffic might fluctuate to ever be able to have a guide that can allow for them, then detect the ones that are "harmful".
This is why SEO is referred to as both art and science, unfortunately.
First - to be clear... If a site has actually been penalized by the search engines, they will send you notification through Bing and Google Webmaster Tools. So you must be certain that both those tools have up-to-date, monitored email address in their notifications settings.
Once you've discounted actual penalties, you're left with fluctuations due to changes in the algorithm. These are not "penalties" in the search engines' eyes, just corrections to the ranking algorithm that happen to affect you.
The best method I've found for spotting these is a combination of segmenting data, keeping accurate records about your own site marketing activities, and monitoring the dates of announced algorithm changes.
The idea here is to try to eliminate as many variable as possible for why traffic might have changed, making it easier to spot changes attributable specifically to algorithm changes. Which would then point you to tactics you might need to use to mitigate the effect of the algo change.
In order to do this, you'll need to do the following:
Track Marketing Efforts & Site Changes
Keep records about your site marketing and structural, coding changes.Anytime you do marketing that could affect site traffic, enter the date and info as an Annotation in your Google Analytics. This includes on and offline things like launching magazine or radio advertising, adding new banner or PPC ads, getting coverage in the media, etc. Anything that could conceivably be causing more people to become aware of you and search for your site. (Remember, just because your ad gives your website address doesn't mean people will remember it. Many will remember your company name or service and will Google it later)
Also keep track of ANY changes made to your website structure - changes in code, robots.txt, .htaccess, canonicals, Analytics configuration etc
Track Announced Algorithm Changes
Use this page http://www.seomoz.org/google-algorithm-change to constantly add dates and info about algo updates into your site's AnnotationsSegment Data Ensure you're only looking at organic search data.
This may seem obvious, but a lot of people miss it. Algorithmic changes are only going to affect your organic search data. So you must ensure you are only looking at non-paid search traffic in your analysis. Fortunately, there's a pre-built Advanced segment for that in Google Analytics. If you're trying to track Google changes specifically, you can further segment to show only Google traffic (i.e. exclude Bing and Yahoo.)
Bonus tip - non-sampled data only Make sure you've asked Analytics to show your reports using as little data-sampling as possible. This will make the data vastly more accurate, although the reports will be a little slower. Definitely a worthwhile tradeoff.
Here's my method:
- pick a date range you're concerned about - the shorter the range the easier to spot anomalies in the graph. Six to eight weeks at a time may be best. Or pick a short range from before and after a date you think you encountered a problem
- segment your data specifically to Google unpaid search, and select as little data-sampling as possible
- look at the traffic line in your graph. Anywhere you see an unexpected drop in traffic (allowing for weekly fluctuations) look for an annotation below that date that might explain it.
So in practice the process might look like this. I'm worried about a traffic drop toward the end of January. I select a date range in Analytics of Jan 1 to Feb 15, and I segment my data to show just Google non-paid traffic for that range. I hit the little checkerboard icon in the top right under the date range and move the slider for Highest Precision.
After dong this, I look at the general pattern of organic traffic to the site. There seems to be the usual ebb and flow of lower weekend traffic, with a small spike of traffic on Jan 15th. When I look just below that date, I notice that I've entered an Annotation. (It'll show up as a little tiny clickable comment bubble). When I read the Annotation I created, it tells me we got a mentioned in the newspaper that day. So I now remember where that spike came from. The traffic then pretty much settles back to normal a day or two after as expected.
Then I notice an unusual drop in traffic around January 23. When I again check for Annotations I've created, I realize there was a Panda update on Jan 22. Since there was no other marketing activity mentioned around that date (like a radio ad ending, for example) I can be pretty sure the sole cause of that drop was the Panda change. And since I know Panda is mostly about devaluing thin or low-value content, I now have somewhere to start looking.
I would then start looking at the non-paid search traffic from specific keywords to see if any group of keywords suffered most heavily. If I can find a pattern to the search terms that dropped, I know I've found the topic area of my site where I need to build some better content to help recover the traffic.
The reason i need to be tracking the marketing efforts as well as the algo updates, is I don't want to miss-attribute the problem. (Correlation instead of causality) For example, if I had a major marketing campaign wrap up on the 20 or 21st of January, that could very well have accounted for the traffic drop, and the Panda update was merely a coincidence.
I wouldn't want to have wasted a whole lot of time chasing the Panda problem, when in fact it was a normal drop due to a cutoff in the marketing campaign. But i would have missed that if I hadn't been tracking the marketing. (For clients sites, you'll need to make the client responsible for keeping the marketing Annotations up to date.)
As you can see, this isn't easy, and it takes laying some groundwork, but it goes a long way to helping you figure out where to focus when you start trying to figure out whether you've been affected by an algo update, and therefore where to spend your energy on fixes.
I know this a helluva lot to throw at you, but the question you asked doesn't have an easy answer and i didn't want to shortchange you with an overly simplistic response. Be sure to ask followup questions for the stuff I haven't' explained clearly enough.
Hope that helps.
Paul
-
Hi,
I am not sure if there is a guide that can tell you exactly why your ranking went down. There are many factors as you mentioned that can cause this such as competitor doing better SEO, getting more quality links and etc. It would be nice to have a guide to learn about what is happening. I may be wrong about this. Hope someone can shed light in this.
-
Thanks TommyTan.
I am definitely referring to the search engines.
I do use Google Webmaster Tools, and haven't seen any email notifications from GWT regarding any spammy link profiles, etc.
I'm more concerned with finding out if it's just normal fluctuation in keyword ranking and traffic, or if there is something else going on.
Sometimes there's so many factors that all could be playing a role outside of any penalties, it would be great to find a guide to help you diagnose if it's just seasonal traffic, keyword rank fluctuation or something more serious.
-
Hi,
I may be way off the chart here but when we talk about website' being penalized, I believe it is mostly related to the search engine. I am not sure what would be penalized that may not be realted to the engines. The best tool that connects to a user's website is the Webmaster Tool. If anything is detected, the webmaster will be notified and a notice will also be available on the Google Webmasters Tool such as unnatural linking, duplicate HTML tags and etc.
Hope this helps =]
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will Google penalize 2 sites for targeting "like" keyword phrases?
I own (2) different websites, one an HTML site that has been live for 20 years and a ecommerce site that has been live for 7 years. We sell custom printed (branded) tents for use at trade shows and other indoor and outdoor events. While our ecomm site targets "trade show" tents our HTML site targets "event" tents. I believe that the keyword phrases are dissimilar enough that targeting "trade show tents" on one site and "event tents" on the other should not cause Google to penalize one or the other or both sites for having similar content. The content is different on both sites. I'm wondering if anyone has experience with, or opinions on, my thoughts... either way. Thanks,
Algorithm Updates | | terry_tradeshowstuff
Terry Hepola0 -
Does Google’s Algorithm Populate Answer Boxes with Its Own Independent Research?
If you search 'best games to play for youtube' you get an answer box with answers pulled independently from the article at hand. Here's an image: http://imgur.com/a/S0j9B Here are all the games from my article, in the order in which they appear. Google's chosen games for Answer Box are bolded: Battlefield 1 Bloodborne GTA V FiFA 16 TrackMania Turbo Garry’s Mod League of Legends Call of Duty: Black Ops III Tom Clancy’s The Division Overwatch Just Cause 3 Counter-Strike: Global Offensive Brawlhalla Rocket League Dark Souls III Unravel Firewatch GoldenEye 007 (this was put in as a joke, but coded as an H2 nonetheless) Destiny Dead by Daylight Fallout 4 Undertale No Man’s Sky Minecraft As you can see, Google is choosing which games to display to its searchers. My Crazy Egg data shows that these were not picked by click volume (each of these H2s are hyperlinked), which means Google must be using some other popularity metric, such as its own search volume data or external sales data. I wrote this up in a post on my site, for anybody who's curious.
Algorithm Updates | | Edward_Sturm1 -
We recently transitioned a site to our server, but Google is still showing the old server's urls. Is there a way to stop Google from showing urls?
We recently transitioned a site to our server, but Google is still showing the old server's urls. Is there a way to stop Google from showing urls?
Algorithm Updates | | Stamats0 -
Google's Mobile Update: What We Know So Far (Updated 3/25)
We're getting a lot of questions about the upcoming Google mobile algorithm update, and so I wanted to start a discussion that covers what we know at this point (or, at least, what we think we know). If you have information that contradicts this or expands on it, please feel free to share it in the comments. This is a developing situation. 1. What is the mobile update? On February 26th, Google announced that they would start factoring in mobile-friendliness as a ranking signal. The official announcement is here. Of note, "This change will affect mobile searches in all languages worldwide and will have a significant impact in our search results." 2. When will the update happen? In an unprecedented move, Google announced that the algorithm update will begin on April 21st. Keep in mind that the roll-out could take days or weeks. 3. Will this affect my desktop rankings? As best we know - no. Mobile-friendliness will only impact mobile rankings. This is important, because it suggests that desktop and mobile rankings, which are currently similar, will diverge. In other words, even though desktop and mobile SERPs look very different, if a site is #1 on desktop, it's currently likely to be #1 on mobile. After April 21st, this may no longer be the case. 4. Is this a boost or a demotion? This isn't clear, but practically it doesn't matter that much and the difference can be very difficult to measure. If everyone gets moved to the front of the line except you, you're still at the back of the line. Google has implied that this isn't a Capital-P Penalty in the sense we usually mean it. Most likely, the mobile update is coded as a ranking boost. 5. Is this a domain- or page-based update? At SMX West, Google's Gary Ilyes clarified that the update would operate on the page level. Any mobile-friendly page can benefit from the update, and an entire site won't be demoted simply because a few pages aren't mobile friendly. 6. Is mobile-friendly on a scale or is it all-or-none? For now, Google seems to be suggesting that a page is either mobile-friendly or not. Either you make the cut or you don't. Over time, this may evolve, but expect the April 21st launch to be all-or-none. 7. How can I tell if my site/page is mobile-friendly? Google has provided a mobile-friendly testing tool, and pages that are mobile-friendly should currently show the "Mobile-friendly" label on mobile searches (this does not appear on desktop searches). Some SEOs are saying that different tools/tests are showing different results, and it appears that the mobile-friendly designation has a number of moving parts. 8. How often will mobile data refresh? Gary also suggested (and my apologies for potentially confusing people on Twitter) that this data will be updated in real-time. Hopefully, that means we won't have to worry about Penguin-style updates that take months to happen. If a page or site becomes mobile-friendly, it should benefit fairly quickly. We're actively working to re-engineer the MozCast Project for mobile rankings and have begun collecting data. We will publish that data as soon as possible after April 21st (assuming it;s useful and that Google sticks to this date). We're also tracking the presence of the "Mobile-friendly" tag. Currently (as of 3/25), across 10,000 page-1 mobile results, about 63% of URLs are labeled as "Mobile-friendly". This is a surprisingly large number (to me, at least) - we'll see how it changes over time.
Algorithm Updates | | Dr-Pete15 -
My Website No Longer Appears in Mobile Google Search but Does in Desktop...Why Is This?
For a long time my website has appeared in both desktop and mobile search in Google. Yet recently it has stopped appearing in mobile yet still on desktop. Any ideas why this is happening and how to rectify it please? Many Thanks.
Algorithm Updates | | WSIDW0 -
Hummingbird - Client took hit. Anyone else?
I recently landed a client about 2 months ago. About 1 month ago organic started to go down. I'm not 100% sure it's Google hummingbird. Has anyone else looked at their GA or GWT and seen a decline?
Algorithm Updates | | Francisco_Meza0 -
Website Penalised | Tips On Recovery?
Hi, I think my website http://rollerbannerscheap.co.uk has been penalised. There are too many over optimised anchor text links with our target keyword 'roller banners' in them. People have linked to our site using our company name 'roller banners cheap' (which also contains the keyword used in my anchor text link building) resulting in too many match links. For a couple months now I have; Added fresh content to the website on a weekly basis, alt tagging images, internal linking and generally making each post very useful. Built a few more external good quality links to try to dilute the over optimised anchor text links. Added more content to the home page. At the moment I am trying to rank for cheap roller banners because I am already on page 1 for that and it seems that keyword hasn't been penalised. Can anyone please advise or recommend what I can do to recover from being penalised or help rank the new key word? I am really stuck with this now and would really appreciate the help. Lewis
Algorithm Updates | | SO_UK0 -
Does Google use data from Gmail to penalize domains and vice versa?
Has anyone noticed issues with Gmail deliverability and spam inboxing happening around the same time as other large Google updates? For example, if Google blasted your site in Panda or Penguin, have anyone seen them use the same judgement across into Gmail deliverability to blacklist your domain?
Algorithm Updates | | Eric_edvisors0