Site is penalized yet Google WTC and SEOMOZ says it's ok!
-
My first question on this community..
A high traffic site of mine has been severely hit for over two months. I took a look at GWTC and noticed a lot of suggestions on the HTML suggestions tab, where I believed that one or a combination of these errors/notices might been causing the penalty. At the moment of typing GWTC shows no HTML suggestions and minor meaningless crawl errors.
Checking on SEOMOZ reported issues, I see zero errors except for a high number of duplicate page titles resulting from tag pages being accessible in the same tag title in paginations (tag.html?page=x) which can be fixed easily by using rel=canonical but I just know it can't cause such penalty. For reported warnings, site has a decent amount of title element being too long and missing meta tag description tags. I have been very active in the past with 301 inner pages of the site to make pages URLs as unique as possible and results were great, but that was long time ago before taking the hit.
The penalty the site suffers from is zero rankings for newly added contents and old contents as well. It has also lost all rankings for its money terms. Site is not banned and still ranking top for its name which is a good thing.
I am not sure where else I should be looking and will appreciate any good advices.
Thanks!
-
Thanks for your reply..
- not hit during on the specific panda dates
- lots of duplicate page titles
- Google Webmaster Reports no major problems
After correction it was hit after panda update or during it. I have, after the hit, did a lot of 302 redirection to newer URLs and title rewriting in a way to make titles and URLs as unique as possible. Google Webmaster was reporting a LOT of HTML suggestions before my action and is currently reporting zero HTML suggestions but a few crawling errors that was solved also a lot of time ago.
_You state that you have lots of duplicate URLs yet you claim this is not the problem yet I would beg to differ. If there are duplicate URLs is there other weak or duplicate content? _
Problem is, the site is sports related. Contents are previews of fixtures of a lot of teams and in many occasions the fixtures are the same (obviously unique content for each preview and unique date as well, represented in the title and URL). Titles and URLs are both more than they should but this can't be helped because of the fix I did to make them more unique!
Secondly, I have a client in the same industry and he is #1 in this industry. The same off-site promotions methods is used for both sites (don't get confused and assumed interlinking, etc..). The time my site took a hit his site performed more than the normal and he had big increase in rankings and traffic. It will be wise to mention that when speaking of contents, although the two sites has the same high quality contents, but my site consists of contents that is shorter (perhaps this makes google thinks this contents is shallow?). More importantly, the change I did to make titles and URLs more unique I never did to his site (I run both!) so in reality his site has a major problem of duplicated titles, yet performing very well, although Google Webmasters Tools is reporting a small amount of HTML suggestions (duplicate title tags) but it seems to help them though. I know we can't rely on this tool because "it is broken" but it helps a lot on many occasions.
Do you have product descriptions that are used on other sites or on multiple pages across the site? Do you have lots of content that is repeated on multiple pages across the site?
No off-site duplicate contents or similarity or widgets descriptions or whatever. The way site is structured and using tags makes a decent amount of tags pages being duplicated with "snippets" of the games previews/contents. I thought about having all tags pages in robots.txt but never executed the idea, and believe it or not on many occasions along the years I have seen googlebots not respecting robots.txt at all. I never thought of removing them manually using Google Webmasters Tools because in my opinion it is very risky and not required!
**The kind of loss of traffic and ranking whilst still maintaining visibility for brand queries smacks of one of the more aggressive duplicate content filters that I have seen at least two cases of recently. These tend to kick in once the site has been crawled so do not stick to any specific date and the result is that you are buried for popular search terms but can still rank for terms with no competition and brand related queries. **
If I combined the site name/brand into a targeted keyword, the site is still ranking but if I did the same combinations with long tails (main landing pages/games previews) there is no result, and the latter is what ensures me there is some penalty or devaluation of contents (short contents=shallow contents?!).
This could be remedied by the following measures:
- canonical urls for any internal page duplication
- **remove thin or weak content pages from the site (delete or noindex) **
- remove or replace any content that is not unique to your site alone (generic product descriptions etc)
- identify any other sites that have stolen your content and request that it is removed & follow that up with DMCA request for any sites that will not play ball
All of these measures has been considered already. For an example searching a snippet of contents return site homepage or other areas of the sites except for the intended ones, that is landing pages.
**Happy to take another look if you can supply a URL. **
I have forwarded the URL to your inbox.
Many thanks for the in-depth analysis, it at least makes me thinks of more issues to investigate.
Regards,
Hossam -
I got you now. I think it's worthy to investigate dropping in rankings in other searching engine as well.
-
For example, if your organic traffic from multiple engines suddenly took a dive at the same time, it might indicate that there is an issue with instructions to the search engines in general. Another user also had Google traffic drop and posted in Q&A, and we discovered that a robots meta tag with "noindex, nofollow" had been placed on many of the pages. It wasn't a penalty at all, it was all of the search engines following the directives given.
In referring sites, if you saw refers come from listofeasytohacksites.com, that could provide a clue as to what is happening.
We are all trying to help here, and trying to make sure something bigger isn't a factor.
-
Hi Hossam,
When you view someone's profile, you should have the option to send them a private message.
For quoting, people have usually just used the copy and paste function and bolded/put in quotes what they were quoting, then responded below the quote.
-
You can private message and my email address is on my profile. Cheers. M
-
There is no quote on this message board and there is no private messaging feature also? I obviously would like you to take a look but I don't want to share the site URL on public.
-
Hi Hossam
If you can post your URL I can take a better look for you.
Marcus
-
Very intensive checklist and great effort that I would like to thank. But I figured out from knowing that panda was on 24th of February adds to the odds that site was affected also by this update and the hit was in early March.
Is there some [quote] option I can use to reply to your response properly?!.
-
I "assumed" Keri was asking about code/links injection and security issues and responded by I know the site is safe and secure. Sorry for the confusion.
-
Right you are! I never related both because for some reason I thought it was in January. But at least I know there is something check list to check against and start getting back to the habit of chasing google updates!
Thanks for the advice.
-
Not sure how is that different. I never even care to take a look at the other segmentation of traffic that is non organic because the site relies on organic traffic and some times PPC. How is this relevant to a SEO hit? I seriously don't understand the logic.
-
I wouldn't assume. This alone would cause your whole site to disappear from the SERPS. I had a wordpress blog last year (using latest version at the time) that got hit, looking at the page in a browser it looked fine and even looking through the source code it wasn't glaringly obvious but the whole page was flooded with spam links.
After removing the code, ranks returned within 10 days
-
I think you've misunderstood what Kerri was saying here. She's not saying that you're not talking about Google organic traffic, she's just trying to find out if it was only that which was affected in order to diagnose the problem. It makes good sense to trouble shoot via segmentation. Have you carried out the segmentation suggested?
-
The update wasn't in January, it was end of February... so March may well have seen problems due to it.
-
Hi Hossam
This kind of thing is tricky without a URL but lets quickly examine what you have stated above:
- not hit during on the specific panda dates
- lots of duplicate page titles
- Google Webmaster Reports no major problems
The Google Webmaster Tools & SEOMoz tools do not scan your site for duplicate content problems, it would be a great addition if they could but it would require cross referencing all the pages against each other and then the rest of the internet so I imagine it would be a bit of a challenge to do so (Rand - you guys love a challenge, right? ;)). The offshoot of this is that you can ignore the SEO advice from SEOMoz and the recommendations from GWMT in relation to your problem.
You state that you have lots of duplicate URLs yet you claim this is not the problem yet I would beg to differ. If there are duplicate URLs is there other weak or duplicate content? Do you have product descriptions that are used on other sites or on multiple pages across the site? Do you have lots of content that is repeated on multiple pages across the site?
The kind of loss of traffic and ranking whilst still maintaining visibility for brand queries smacks of one of the more aggressive duplicate content filters that I have seen at least two cases of recently. These tend to kick in once the site has been crawled so do not stick to any specific date and the result is that you are buried for popular search terms but can still rank for terms with no competition and brand related queries.
Link devaluation was mentioned above but if the drop has been sudden and severe I would suspect a penalty is far more likely rather than a slow slide over x weeks, months into the doldrums.
Without a URL we can only theorise up to a point. To do some more in depth analysis and hang some meat on this theory we need to see your web address but from instinct and the information currently supplied, it sounds like you have a duplication penalty.
This could be remedied by the following measures:
- canonical urls for any internal page duplication
- remove thin or weak content pages from the site (delete or noindex)
- remove or replace any content that is not unique to your site alone (generic product descriptions etc)
- identify any other sites that have stolen your content and request that it is removed & follow that up with DMCA request for any sites that will not play ball
Generally, review the quality of your site and it's content specifically with an eye to make sure your content is unique, not repeated internally, there are not duplicate URLs and that your content has not been stolen by other sites (google sentences from your site in double quotes for a simple check, use copyscape for something more indepth).
Happy to take another look if you can supply a URL.
Regards,
Marcus -
If that's the case and I assume it is, my site is safe and secure. Let's speak SEO please.
-
Obviously I am speaking about Google organic traffic, Keri!
-
In your analytics, when you segment out by source, how is direct and referring traffic? Have either of those taken a hit, or is it mainly search traffic? And is it just Google, or have all of the major engines taken the same nose dive?
-
MagentoWebDeveloper, are you referring to the new black hat practice of hacking a site and putting in cross-domain canonical tags to a different site?
-
Sorry, what you mean by URLs I don't recognize?
-
Nope, off-site promotion is out of the formula. Also the site hasn't been affected by January update (it was hit on March) and obviously the recent updates in May had no effect neither since the site was penalized before them.
-
Check your source code for URLs you don't recognize.
-
did you have a lot of cheap links?
could it be you have lost a load of links in the recent algo updates?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What's the best way to eliminate "429 : Received HTTP status 429" errors?
My company website is built on WordPress. It receives very few crawl errors, but it do regularly receive a few (typically 1-2 per crawl) "429 : Received HTTP status 429" errors through Moz. Based on my research, my understand is that my server is essentially telling Moz to cool it with the requests. That means it could be doing the same for search engines' bots and even visitors, right? This creates two questions for me, which I would greatly appreciate your help with: Are "429 : Received HTTP status 429" errors harmful for my SEO? I imagine the answer is "yes" because Moz flags them as high priority issues in my crawl report. What can I do to eliminate "429 : Received HTTP status 429" errors? Any insight you can offer is greatly appreciated! Thanks,
Moz Pro | | ryanjcormier
Ryan0 -
Rogerbot crawls my site and causes error as it uses urls that don't exist
Whenever the rogerbot comes back to my site for a crawl it seems to want to crawl urls that dont exist and thus causes errors to be reported... Example:- The correct url is as follows: /vw-baywindow/cab_door_slide_door_tailgate_engine_lid_parts/cab_door_seals/genuine_vw_brazil_cab_door_rubber_68-79_10330/ But it seems to want to crawl the following: /vw-baywindow/cab_door_slide_door_tailgate_engine_lid_parts/cab_door_seals/genuine_vw_brazil_cab_door_rubber_68-79_10330/?id=10330 This format doesn't exist anywhere and never has so I have no idea where its getting this url format from The user agent details I get are as follows: IP ADDRESS: 107.22.107.114
Moz Pro | | spiralsites
USER AGENT: rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-crawler+pr1-crawler-17@moz.com)0 -
What's the best way for SEO newbie to analyze & fix a site after being hit by Panda?
Hi, I have a prospective client who was in the top 3 on Google for two of their primary keywords. They fell way back in the rankings immediately after Panda was rolled out on September 27, 2012. Two weeks ago, they were at position #118 for one keyword. After looking for them in Rank Checker today, they cannot be found in Google at all. Here's my question. Because of the "bad links" (some pointing to Porno sites)... what's the possibility that this situation cannot be fixed? I don't know... maybe I'm asking an irrelevant question. I'm attempting to assess the situation so I can go back and present my findings to the prospective client. I'm committed to understanding what's going on with their website so I can assess the situation properly. Fixing their problem starts with a correct assessment. They have a ranking problem, and I know I can fix that... IF all their site needs is white hat <acronym title="Search Engine Optimization">SEO</acronym>. What I DON'T want is... to sell them <acronym title="Search Engine Optimization">SEO</acronym> services, only to find out in 3-6 months... I made an incorrect diagnosis of the problem, and therefore sold them the wrong solution. I know I can close the sale if I can show them with reasonable substantiation that the damage is not beyond repair. I'm familiar with the basics of <acronym title="Search Engine Optimization">SEO</acronym>, but I'm unfamiliar with how "bad linking" might effect the long-term commitment to optimizing. They're wondering if they should start over on another website. I was attempting to do an assessment to better understand if my typical approach on this site would be sufficient. Also... I wanted to get an assessment/report to show them something to substantiate my conclusion(s) about their website. If Open Site Explorer is sufficient to do the link analysis... great. At least I know I'm working with the right tool. All I have to do is learn how to use the tool quickly. At this point... I'm not sure which tool would be helpful. So... can you speak to the following 2 questions: 1.) How do you know when ranking problem is beyond fixing? 2.) What software/tool is ideal for doing some link analysis in order to assess the problem, and prescribe a solution? Thanks so much! Ramon
Moz Pro | | 48dayscoach0 -
Big changes in site titles
So as I pour though some of the diagnostics data for over 100,000 pages of my site I see thousands of page title that "could" be changed. Could this cause some lost traffic for a while due to the big changes?
Moz Pro | | dvduval0 -
Open Site Explorer Not Working on 99% of Sites
I'm trying to use Open Site Explorer, but whenever I try to I get the error message "Ouch! It Looks Like Something Went South". Interestingly, I don't have this problem when entering a very popular site like google.com, yahoo.com, bbc.co.uk. Is there a problem with the tool at the moment, or something wrong on my end?
Moz Pro | | EssexGirl1 -
Google UK rankings don't seem to be accurate.
Just a quick question - I am tracking the keyword 'chemistry teaching resources' as part of a campaign and our site comes up at number 4 on a google.co.uk search for this however in the rankings report section of our account, we are ranked at number 50 for this keyword in the 'google UK' column. Does anybody know why this would be different? It is also different for a number of other keywords in the campaign. Any help you could give would be much appreciated. Thanks
Moz Pro | | EdwardUpton610 -
Open Site Explorer Data
Good afternoon SEOmoz, I first want to congratulate with you for the amazing new look and new features of Open Site Explorer, it's an amazing and valuable tool that I use every day and that has helped me build tons of links for my clients. I have been keeping track of the OPE data on a monthly base and I just noticed something strange. In May 2011, OSE was showing that my client's website had 12,624 links, in July 2011 the website had 14,157 links and today I just ran a new report that showed just 6,401 links. I don't want to believe that in 2 months we lost half of the links, so I was wondering if you guys can give me more insights about this data.
Moz Pro | | Aviatech
Did SEOMoz change the way they measure the number of links? Or is this just a bug or issue they are having with the new version of OSE? Thanks!0 -
Why aren't DMOZ links showing up in Open Site Explorer?
I have a page that is listed in DMOZ.org, but when I run an OSE Link Analysis, that link doesn't show up. I'm currently doing the free trial for SEOMoz Pro and I'm concerned that other links might not be showing up as well. Has anyone had any similar experiences and/or do you know why DMOZ links specifically might not appear in the results?
Moz Pro | | JoyceScott0