Farmer Update Case Study. Please question my logic here. (Very long!)
-
Hi SEOmoz community!
I would like to try to give a small (well...) case study of a Farmer victim and some logical conclusions of mine that you are more then welcome to shred to pieces.
So, I run MANY sites ranging from low to super quality and actually have a few that have been hit by farmer but this particular site had me scratching my head as to why it was torched.
Quick background: Sitei s in a very competetive niche, been around since 2004 initially as a forum site but from 2005 also a content driven site. Site is an affiliate site and has been ranking top 5 for many high-value commercial KW's and has a big long-tail of informational kw's. Limk profile is a mix between natural, good links and purchased links from various qualilty sources.
Content is high quality written articles, how-to's, blog posts etc. by in-house pro writers plus UGC from a semi active forum (20-30 posts a day).
Farmer: After Farmer, this site's vertical is pretty much same as before with the biggest exception being my site. I quickly discounted low-quality content (spider-food) and focused instead on technical reasons. I took this approach since this site isn't the most well kept site I have and I figured the crappy CMS + PHPBB might have caused isseus.
I didn't want to waste my time crawling the site myself so I quickly downloaded all the URLs that Majestic had crawled. Too my surprise the result of Majestic's crawler was over 3 million URLs when the real number would likley be 30-40k and Google has about 20k indexed.
After scanning through the file with URLs I knew I had issues. Massive amounts of auto-generated dupe pages from the forum and so on. By adding around 20 new lines to robots.txt I was able to block millions of pages from being crawled again.
My logic: Ok, so now I think I've found what caused the drop. Milllions of dupe pages and empty pages could have tripped the Farmer algo update to think the site is low quality or dupe or just trying to feed the spiders with uselessness.
My WEAK point in this logic is that I can't prove that Google even knew about (or smart enough to ignore them). Google WMT tells me they've crawled an average of around 10k pages the last 90 days. Given this I'm doubting my logic and if I've found the issue or not.
My next step is to see if this gets resolved algorithmically or not, if not i feel I have a legitimate case to submit a reinclusion request but i'm not sure?
Since I haven't been a contributing member to this community I'm not looking to get direct help with my site, but hopefully this could spark some discussion about Farmer and maybe some flaming of my logic regarding the update
So, would any of you have drawn similar conclusions as I did? (Sweet blog bro!)
-
Good to hear that all your rankings have recovered. How have things gone the past couple of weeks, do you have anything you can share here? Or maybe even for a YOUmoz post?
-
The site is back, all rankings recovered.
-
Hi Barry,
Thanks for bringing up some great points!
I probably should have talked about the effects the update had on the site in my op
Well, it was a drastic drop in rankings for pretty much everything the site ranked for, at least 20-40 positions drop acroos the board EXCEPT for the most commercial/highest volume KW's that only resulted in a 3-6 position drop (still top 10 for the most part.The landing pages, that dropped the least, for the commercial queries is obv. where all the paid links go to (mostly from sites in my niche that are still doing fine). The informational pages that got hit the worst only ranks because of natural links from great/good sites that were not affected by farmer and domain authority.
I really see your and Dan's point about Google not caring about the millions of urls but i can't shake the feeling that it might have tripped the wire somehow
FTR, I'm not complaining about my situation, just generally surprised about this site getting hit when I have a ton of sites that deserved to be torched when I feel this site is actually "clean". I think this is why my logic seems strange to you
Anyway, another great reply, thanks!
-
What's actually changed for you though? Have you looked in the analytics to see what pages are no longer bringing traffic, what keywords are no longer bringing you traffic, that kind of thing?
Is it across all pages and all keywords or is it just a few high traffic keywords and pages?
Just because your niche has many link buyers doesn't mean that you're not getting penalised for it
I don't think Google will have known or cared about those millions of pages, I assume none of them have shown up as a landing page for visitors so I would guess they were effectively invisible to Google.
Paid links (and indeed normal links), you may not be getting penalised for them, but if some of your highest value links are themselves being punished or in some way devalued you may be losing out there as well.
I asume no other significant change occured at this time?
-
Hey Dan,
Thanks for replying! I figured the purchased links would come up but I have pretty much discounted that since the niche is crowded with link buyers and no-one got hit. I'm also active in other verticals where lik buyers prosper and I haven't seen any impact on just about any of them.
In comparison, my sites link profile is pretty vanilla compared to many other sites. That said, I know I can't discount the links 100% as being the reason here since I've been paying for them.
Really appreciate you taking the time to reply!
-
My first knee jerk response to this post is to target the part about purchased links. If you have paid links, then I would remedy that problem before I look at anything else.
Do you have a lot of adsense on this site? I've been hearing left and right that a lot of sites that got hit hard were those with 5 or 6 adsense units on one page. Excessive ads drive users crazy, so Google could be torching you for that.
As for the auto generate dupe content pages, Google may or may not have found them. Were there links to these pages? Do you know how Majestic found them?
If you never linked to these pages it is unlikely Google ever found them. Google tends to only crawl content with links or found in a sitemap. If you never had links to those dupe pages and they weren't in your sitemap, I doubt it is causing the problem. Plus if that were the issue, you probably would have been torched long before this algo update.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Nov 19th & 20th Update?
Did anyone see any big changes around Nov 19th & 20th? Mozcast had some high temps around there. If you saw any big changes in organic search, any ideas WTH that was all about? Any guesses? One site I work with took about a 15% hit and has since sort of skidded sideways.
White Hat / Black Hat SEO | | 945010 -
Should i rank for one tail keyword or long tail keywords
Hi guys, for example i run a coupon site and would like to rank for the brand keyword ASOS, should i just rank for the long tail keywords for example "ASOS discount code" instead of just "ASOS"? even the traffic for ASOS itself is MUCH higher than ASOS discount code? And the relevancy of ranking at "ASOS" is fine too because is somehow relevant? would ranking long tail helps with one tail keyword too? And assuming that i am already on the second page for the keyword "ASOS" and knowing is not hard to be page one. should i just rank the one keyword?
White Hat / Black Hat SEO | | andzon0 -
Please Correct This on-site SEO strategy w/ respect to all the updates
Hello, I believe my on-site SEO process that I used to use a couple of years ago is not working well anymore for a couple of my sites, including this one. I'll tell you the old strategy as well as my new strategy and I'm wondering if you can give me pointers that will help us rank where we should rank with our PA and DA instead of getting moved down because of what could be our old on-site SEO. OLD ON-SITE SEO STRATEGY: Title tags usually match the page, but title tags occasionally on this site don't match the pages exactly. There's not many of them, but they do still exist in a couple of places. Title tags are either 1. A phrase describing the page 2. Keywords 1, Keyword 2 3. Keyword 1 | Keyword 2 4. Keywords 1, Keyword 2, branding The keywords are in the h1 and h2 of each main page, at the very top of the page. The h1 and h2 do not exactly copy the title tag, but are a longer phrase with the keywords appearing in their exact word order or in word variations. See this page for an example. Keywords occur 3-4 times in the body of the main pages (the pages with a menu link). Right now some of the pages have the exact phrases 3 or 4 times and no variation. meta description tags have exact keyword phrases once per keyword. Meta description tag are a short paragraph describing the page. No meta keyword tags, but a couple haven't been deleted yet. FUTURE ON-SITE SEO STRATEGY: I'm going to change all of the page titles to make sure they match the content they're on exactly. If the title is a phrase describing a page, I'm going to make sure a variation of that phrase occurs at least three times in the content, and once in the meta description tag. Title tags will be either a. Short phrase exactly matching page b. Keyword 1, Keyword 2 | branding c. Keyword 1 | branding 2. I'm thinking about taking out the H1 and H2 and replacing them with one tag that is a phrase describing the page that I'll sometimes put the keyword phrase in, only a variation in it and not the exact keyword phrase - unless it just makes total sense to use the keyword phrase exactly. **I'm thinking of only using the keyword phrase in it's exact words once on the page unless it occurs more naturally, and to include the keyword phrase in word variations two more times. So once (in non-exact word order) in the at the top, once (exact word order) in the text, and two more times (varied word orders) somewhere in the text. All this will be different if the keywords show up naturally in the text. **3. I'll delete all meta keyword tags, and still use exact keyword phrases in meta description tag, though I'll change the meta description tags to always very closely match what the page is about. Do you think my new strategy will make a difference? Your thoughts on any of this?****
White Hat / Black Hat SEO | | BobGW0 -
What is the difference between Positive Impact, No Impact, Negative Impact and Extremely Negative Impact in term of Google Update like panda or penguin etc.
What is the difference between Positive Impact, No Impact, Negative Impact and Extremely Negative Impact in term of Google Update like panda or penguin etc.
White Hat / Black Hat SEO | | dotlineseo0 -
Black Hat Link Building Ethics Question
I have taken on the SEO/Inbound duties for my company and have been monitoring some of our competitors in the market space. In June one of them began a black hat link building campaign that took them from 154 linking root domains to about 7500 today. All of the links target either /header or /permalink/index and all have anchor text along the lines of "Windows 7 activation code." They are using forgotten forums and odd pages, but seem to be finding high DA sources to place the links. This has skyrocketed their DA (40 to 73), and raised their mozRank, mozTrust, and SERP positions. Originally I thought to report it to Google, but I wanted to wait a few weeks and see what the campaign did for them and if Google would catch on. I figured adding 81K links in 2 months would trigger something (honestly, if I was able to find out they were doing it then it's got to be obvious). But they have grown every week and no drop in rankings. So my question is would you report it? Or continue to wait and see? Technically they are not a "competitor" in the strictest sense of the word (we actually do sell some of their products as OEM), but I find the tactic despicable and it makes my efforts to raise our rankings and DA seem ineffective to people not in the know about SEO. Interested to see everyone's responses! Taylor
White Hat / Black Hat SEO | | anneoaks0 -
Please Help- Confusion about how to Avoid Keyword Self-Cannibalization and Keyword Stuffing
I am pretty much a rookie when it comes to the SEO game and to be completely honest SEO is really confusing. I just recently started using MOZ and I was looking at my On-Page report and I saw that I needed to correct some “Avoid Keyword Self-Cannibalization” errors. So I looked at the error and the fix. Here is what MOZ gave me. Cannibalizing link "How to make a fake diploma", "How to get a fake diploma", "Making a Fake High School Diploma", "Fake Diploma Template", and "Framing your fake diploma" Explanation It's a best practice in SEO to target each keyword with a single page on your site (sometimes two if you've already achieved high rankings and are seeking a second, indented listing). To prevent engines from potentially seeing a signal that this page is not the intended ranking target and creating additional competition for your page, we suggest staying away from linking internally to another page with the target keyword(s) as the exact anchor text. Note that using modified versions is sometimes fine (for example, if this page targeted the word 'elephants', using 'baby elephants' in anchor text would be just fine). Recommendation Unless there is intent to rank multiple pages for the target keyword, it may be wise to modify the anchor text of this link so it is not an exact match. This error is for my Hompage(http://www.fake-diploma.com) for the keyword Fake Diploma. My understanding is that for Self-Cannibalization to occur I would have to have a link on this page pointing to another page using "Fake Diploma" as my anchor text since I want this page to rank for Fake Diploma. I do have the right hand sidebar which contains my most recent posts and some of my titles do include Fake Diploma. How to make a Fake Diploma
White Hat / Black Hat SEO | | diplomajim
Fake Diploma Template
Framing your Fake Diploma
To me theses are separate longtail keywords. While they do include Fake Diploma in them I thought theses were fine because they are not an Exact Match to each other nor are they an Exact Match to “Fake Diploma”. Am I wrong about this? Secondly I reached out on another Forum trying to get a better understanding of this and just got even more confused. I was told that I am also Keyword Stuffing and could be penalized. They said because I have Fake Diploma in most of my article titles that I am Stuffing Fake Diploma. I am in a Niche Market and of course most of my titles include Fake Diploma because that is what my entire site is about. I used the Google Keyword Tool and searched Fake Diploma and it gave me a list of about 79 related keywords like: Make a Fake Diploma Online
Create a Fake Diploma
Fake Diploma Software This is just a few of the many that I have. I thought the best way to rank for a keyword was to actually write a post about that Keyword and use it as the title of the article. I am not over using the Keyword in the actual article and I maybe have a Keyword density of about 2-5%. I thought Keyword Stuffing was where you actually used the Keyword like 50 times and also just added random Keywords to the article that did not belong. Please help me with any insights you can offer. I feel like I am doing all of this completely wrong.0 -
Please help? unique penguin problem with a blogger template
**Can any one help? The problem: **There is a free blogger template on this site http://btemplates.com/2012/blogger-template-crystalweb/ that has a anchor text link to our site using the keyword "wholesale" in the footer, that is the main course of our site being hit with a penguin penalty.**The story so far:**On the 24th April our website dropped out of the serps for our main keywords, traffic has been down 90% ever since, we are a small family run business that relies on the inter-net and goggle for our site to work. Goggle organic serps is about 30% of our turnover and have already had no choice to let 3 people go, problem now is we are left with Me, my Dad and Mum, Both my Brothers and nephew and my wife and my brothers wife so unless we can turn this around I can see us going bankrupt.**What I have done so far:**After the 24th I have learnt a lot about S.E.O , and managed to remove 99% of all bad/spammy links and have now come to a dead end. I have been promoting what we do as a company and promoting our blog over the last 4 months and also built a great twitter/facebook following with lots of re-tweets and shares which we have made some good sales from. We have re-designed most parts of our website and managed to up the conversion rate by 300% We have worked on all aspects of our website to make sure we have little/no duplicate content , have worked on ways to speed up the site and fixed most dead links/404 problems.<var id="yiv904548185yui-ie-cursor"></var>**Now onto our main problem:**After a few weeks of removing links I found a blogger page that kept coming up with the same link, after some detective work I found the template was originally designed by http://www.deluxetemplates.com/ after a few emails we found out that someone paid deluxetemplates to add the link to the site, I'm guessing it was a S.E.O. company we used for 2 years, but they did not admit to this and could not help. A guy called Klodian from deluxtemplates was really helpful and helped remove from his site, also he agreed to a cost of $250 to remove all the pictures on his server to force the blogger's to update, this is what the template from deluxtemplates now looks like vozconuncion.blogspot.co.uk .Now this was only helping fix this issue a small bit as a different site called btemplates also used the template and added it to there website as a free download and hosted the template pictures on there servers. I have emailed a few times, I have sent them twitter messages and also added messages to lots of there templates on there site in the hope they can help, I have also contacted the owner directly on his goggle+1 page but no reply. This template is being downloaded once or twice a day, with no way to get hold of the blogger's using it. As a last resort I offered the owner $1000 to help me remove the template but still no luck.Does anyone have any ideas how to resolve? we are willing to pay to resolve this and will do what ever needs to be done.Thank-you for taking the time to read.Karl.
White Hat / Black Hat SEO | | wcuk0
