Blocking external links in Robots.txt - need advice on Best Practice
-
I look after an affiliate site that is doing quite well in the search rankings. We've been doing a review of our practices and one thing that has cropped up is our robots.txt.
In it, we disallow Google from crawling external links. This used to be best practice in the affiliate industry a couple of years ago, but I wanted to know if this is still the case, and what the implications are if we were to:
a/ leave it as is?
b/ allow crawling?
Thanks in advance.
-
I'm not sure how you're blocking Google from crawling external links in the robots.txt file--typically you only block them from crawling internal pages on your site.
If you're using a script, though, to track the clicks on external links and that script is running your site (and you're blocking that script in robot.txt), then that still should be fine. You may want to add a "nofollow" tag on those links, though, so you don't end up passing link "credit" or "link juice" to those affiliates (unless you want to do that?).
As far as external links go, though, it's typically okay (and expected) that you link out to other sites.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
NoFollow Affiliate links from (very) shady websites will effect rankings?
Should I be worried , and if so what to do, if affiliates are linking from shady / gaming/adult websites? or dost the fact that the links are nofollow solve this issue completely ?
Affiliate Marketing | | KSafer0 -
What is the right way to link to your main site?
Hi, we have a system for tracking the leads that comes from a specific affiliate website. each affiliate has a unique tracking code. not only for affiliates that work with us but also for the SEO team has an affiliate tracking code so our bosses can track the leads and traffic that come from the activity of the SEO team. this means, links towards our website look like: www.mydomain.com/?t_src=campaign&t=AFF&t_cre=links&A=371 www.mydomain.com/?A=371 I have few questions about this: 1. This is the right way to link to my company site? How dose google crawl those link? It's can harm the link value? 2. What is my option to show my boss all the traffic / leads that our seo team brings to the site trough Google Analytics? Hope to get your support. Thanks in advance.
Affiliate Marketing | | JonsonSwartz0 -
Can linking out to a weak site harm my sites SEO?
We have an affiliate that wants us to link to his site to help him get started. His website looks okay and is in the same niche as us. However, he has PR 0 and no Page Trust. We could work in a natural looking link in a news article, but there is no way he could be considered any kind of "authority" link. Can linking to his site harm us?
Affiliate Marketing | | theLotter0 -
Linking from High Authority Sites
Dear Mozzes, We're running a property portal for real estate classifieds which receives around 300.000 visits monthly. PA 47 DA 37 Mozrank 5,3 MozTrust 5,8 PR 4 Apart from our real estate classifieds we are producing proprietary trends and statistic, a rare commodity in the country we operate. Luckily we are about to enter into a partnership with one of the leading newspaper portals in the Country, appreciating PAs in the 80-90s. In this coming partnership we will provide: 1. Market statistics, which we can imagine as a chart followed by our logo and a "Powered By", which shall link to our site. 2. An in-framed part of our site in their portal where we list properties for sale, that will carry affiliate strings. In order to for us to get the maximum link value of this high authority site, how should we build the integration and linking? We've looked at similar examples here http://realestate.money.cnn.com/ here http://realestate.money.cnn.com/NY/New_York/ or maybe like the Simply Hired logo here: http://money.cnn.com/ Advices here would be super appreciated. Thanks Eric
Affiliate Marketing | | PropertyPortal0 -
Does Google look at Domain Registrar owner information when counting links into a site?
Question: If the domain registrar owner info is the same on two websites, will Google/other search engines discredit any linking between the two sites when calculating page rank? We have two company sites. One is our main ecommerce domain which we have been linking into from information domains in the past. We recently cut ties with the company that hosted them for us and wish to host them ourselves to preserve the inbound traffic. We are worried, however, that the traffic will be discredited now that we own both domains. Thanks for looking!
Affiliate Marketing | | tennisexpress0 -
What is the negative effect of getting affiliate links to your domain?
Are the negative effects of affiliate links to your domain bigger than the positive effects? Is it better to use a subdomain for your affiliate campaigns? (Because of linkprofile no follow links or time on page effects?) Thanks for responce!
Affiliate Marketing | | ltom0 -
Sponsored Links on Amazon, help
So from what I can see CLickrive was discontinued by Amazon, replaced by a9. I have been asked by a client how they can get onto Sponsored Links near the bottom of a search query on an amazon page. Now I can see from the amazon associates site that you can put widgets, display ads, product search links etc but there is no mention of 'Sponsored Links' other than: SPONSORED LINKS Sponsored links are advertisements related to your recent product search query or content on the page. Sponsored links are always clearly labeled. When you click on a sponsored link, we get revenue. Generating additional revenue from sponsored links allows Amazon.com to offer lower prices to you - something we are dedicated to doing in every way we can. There is no mention on how to actually be a sponsored link... I have read on various blogs etc that it is delivered by a third party network... no mention as to whom... thought Google but no mention of this on any information I can find on Google blogs etc. Anyone have an idea? Thank you 🙂
Affiliate Marketing | | ChalkWard0 -
Best way to start affiliate marketing a new mens magazine website?
I have just started up a new mens magazine website featuring articles, videos, sports news and photos to help drive traffic to the website. I write all the articles myself and do the social media updates in my spare time. I was wondering if anyone has any tips on the best way to start doing affiliate marketing for a new website? I was inspired to do this by successful internet marketers who make a passive income off their websites. So far I have added Amazon and William Hill as affiliate links as I think my target market will be looking for these types of product links. Also, for anyone who has experience in this, how long it taken for your blog to become successful and make money? Many thanks, Alex
Affiliate Marketing | | AlexBarnes0