Deny visitors by referrer in .htaccess to clean up spammy links?
-
I want to lead off by saying that I do not recommend trying this. My gut tells me that this is a bad idea, but I want to start a conversation about why.
Since penguin a few weeks ago, one of the most common topics of conversation in almost every SEO/Webmaster forum is "how to remove spammy links". As Ryan Kent pointed out, it is almost impossible to remove all of these links, as these webmasters and previous link builders rarely respond. This is particularly concerning given that he also points out that Google is very adamant that ALL of these links are removed.
After a handful of sleepless nights and some research, I found out that you can block traffic from specific referring sites using your.htaccess file. My thinking is that by blocking traffic from the domains with the spammy links, you could prevent Google from crawling from those sites to yours, thus indicating that you do not want to take credit for the link.
I think there are two parts to the conversation...
-
Would this work? Google would still see the link on the offending domain, but by blocking that domain are you preventing any strength or penalty associated with that domain from impacting your site?
-
If for whatever reason this would nto work, would a tweak in the algorithm by Google to allow this practice be beneficial to both Google and the SEO community? This would certainly save those of us tasked with cleaning up previous work by shoddy link builders a lot of time and allow us to focus on what Google wants in creating high quality sites.
Thoughts?
-
-
I've thought about this idea to get rid of bad links from specific referrers.
I agree with the comments Ian has made but when it is the homepage it's not always possible to follow those steps. Has anyone else had any experience/information?
-
Hi Ian,
Thanks for the response. I agree with you that this feels wrong and I don't recommend anyone try this (unless you have a site that you don't mind using as a guinea pig).
The problem is that, if this is your home page or a strong category page with many legitimate links, rankings, ect., it will be tough to abandon the page altogether.
To follow up about the original idea, I have done some additional research and found a few mentions, though none of them exceptionally credible, of the fact that the Googlebot does not pass referrer data to the server. Can anyone confirm?
-
Ooooh, that feels all wrong.
Seems to me .htaccess would block visitors that you may want. And while Google may obey the directive, they may also misinterpret a referrer-specific directive as cloaking.
If you want to get the same effect, here's what I'd do:
- Change the page to which the offending links point. Have it say "This page is gone, but you can get the information you want here" and make that a link to a new page.
- Set up your server to return a 410 code when folks visit that page.
- Set up a new page with the old page's content, so folks can click from the old to the new, but visiting bots and browsers get a 410 code and dump the page.
That will get Google to de-index the page in a hurry.
Another option: Simply add noindex, nofollow to the targeted page.
But I like the 410 option, because that should break the authority flow and has the best chance of giving Google what it wants, short of removing the link.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Subdomain and Domain Linking Strategy
Here is my question for SEO. We are a mug printing company and we have a website specifically for bulk orders hosted at our main link (example.com). For the purposes of this example we will assume that we only print mugs for bands. Eg. orders for 100 mugs at a time for a band. We have had a need to create stores for bands so that they can then pass a link to their fans to purchase mugs. Our main website deals specifically with bulk orders only with customer provided logos, so extending this workflow to our main domain takes quite a bit of development time. Because of this, we purchased a service that allows us to create stores under the new domain stores.example.com. The root domain is the same as our main domain but there is “stores” in front of the domain. A band’s website that we would create would then look something like : stores.example.com/band1_merchandise These links are going to be spread by the band all over the web, and it is in my hope to be able to take advantage of this. Ideally stores.example.com/band1_merchandise being spread around will also give us a boost to www.example.com My question is how can we benefit the most from bands sharing the subdomain link such that our main website will be able to see an SEO benefit.
White Hat / Black Hat SEO | | masonwong0 -
How do I deal with Negative SEO (Spammy Links)?
For the past 12 months, our website has been hit by spammy links with annoying anchor text. We suspected one of our competitor are deploying negative SEO on us. The image is an example of the sites and anchor text we have been spammed with. The frequency is about 1 - 2 spammy links a day. I have a few questions from here onwards: Does those links affect our SEO? (Most are mainly nofollow) Other than disavow, what other stuff can I do? How will google and other search engines see this incident? TcmFsti
White Hat / Black Hat SEO | | Changsst0 -
Links Identified in WMT not on Webpages
Hi, We're currently reviewing one of our clients backlinks in Google Webmaster Tools, Majestic & OSE as we can see many toxic links. However we cannot find the links on the webpages that are listed on Google WMT. We have searched through the website along with checking through the source code. Should we still disavow the domain? Thanks, Edd
White Hat / Black Hat SEO | | tomcraig860 -
How do you change the 6 links under your website in Google?
Hello everyone, I have no idea how to ask this question, so I'm going to give it a shot and hopefully someone can help me!! My company is called Eteach, so when you type in Eteach into Google, we come in the top position (phew!) but there are 6 links that appear underneath it (I've added a picture to show what I mean). How do you change these links?? I don't even know what to call them, so if there is a particular name for these then please let me know! They seem to be an organic rank rather than PPC...but if I'm wrong then do correct me! Thanks! zorIsxH.jpg
White Hat / Black Hat SEO | | Eteach_Marketing0 -
External Followed Links Over Time Nasty Drop HELP!
I had someone help me with SEO and they basically used some stupid form to get back-links I am still learning and have taken over my site to better do things right. I have had a major drop across the board since Panda and Pinguin and rightfully so from what I am seeing. My question is: Google obviously removed the backlinks and SEO MOZ shows this in its report. Do I need to disavow these links still or can I just focus on link building properly? What is the best course of action here? gGuSyJf
White Hat / Black Hat SEO | | megapixall0 -
Infographic submission sites potentially offering paid links....
Good Morning/Afternoon fellow Mozzers, I recently created an infographic and am now looking to get it distributed via as many publications as possible. I discovered some great sites with collections of infographics.However I have discovered a multitude of sites offering to review and feature the infographic, or "express" submissions so the graphic features faster for a price..... links below. http://www.amazinginfographics.com/submit-infographics/ http://infographicjournal.com/submit-infographics/ 2 questions 1. Is this considered as buying links? My instincts say Yes. 2. Some sites offer mix of free and "express" paid submissions. If the answer to Q.1 is yes, should I avoid them all together even if my graphic gets picked up free? Thanks in advance for the feedback.
White Hat / Black Hat SEO | | RobertChapman0 -
Link-Building - Directories
Hello, The SEO world is a bit confuse in the last months with the Google Antartic updates. Its normal since Google is trying to kill SEO to have more Adwords publicity results. My most recent doubt is about directories. I heard Matt Cutts from Google in a recent Google Hangout saying that registering a website in directorys was ok, but not the ideal method to become relevant in the internet world. However it seems that this procedure is not against the Google policies. Now, here in the forums, I already saw someone writing about adding your site to directories and how dangerous that situacion is. So, whats your opinion about adding your site to free and pay directories as first link-building strategy? If directories are out of the question, why SEOmoz as a huge list of paid directorys? Is SEOmoz outdate?
White Hat / Black Hat SEO | | PedroM1 -
Huge diifference linking root domains in SEO MOZ and opensite explorer
Hi there, I have fairly large site that has never really been optimised. I think an old forum i hosted has either been spammed or my webmaster at the time used some black hat techniques to get me more root linking domains. I am a newbie and would really appreciate if someone could just quickly look at my donain and confirm that this is a problem and something i should fix before i start my SEO campaign. I am also worried this will negatively effect my domain authority. I dont really want to broadcast my domain so if anyoone would be so kind to confirm the problem so i cant start to research the answer. Thanks v much
White Hat / Black Hat SEO | | nimble0