No index, or no index no follow?
-
Wondering if I could garner some views on this issue please.
I'm about to add an affiliate store to a website I own, the site has a couple of pages of unique content (blogs, articles, advice etc on home improvement - all written by my team). Obviously, the affiliate store will not be unique content, it will be made using the datafeeds from cj.com et al, and so I don't want to get any duplicate content type penalties from Google for this store.
Should I add a no index to the pages and allow the bots to still crawl them, or should I add no index and no follow? Ideally I would like to get the affiliate store category pages indexed as they will be a mixture of lots of different merchants and be fairly unique.
Can Google still mark the site down for duplicate content if it can crawl it, even if it is noindex?
Thanks,
Carl
-
Carl, I have a few ideas and suggestions. I will respond to your original mentions:
"Obviously, the affiliate store will not be unique content, it will be made using the datafeeds from cj.com et al, and so I don't want to get any duplicate content type penalties from Google for this store."
I find this interesting that you automatically assume that you have to use the original datafeeds from CJ. I would encourage you to contact Commission Junction directly on this matter. Many services allow you to provide an alternative product description, etc.The faq section of feedwizards has an example which you can read about here: https://dashboard.feedwizards.com/faq/9 (look for: How do I avoid duplicate content on shopping engines & affiliates using my feeds)
Matt Cutts as also spoken on this topic as well in the video I included. http://www.youtube.com/watch?v=z07IfCtYbLw
Hope this helps
-
Hi Carl,
Don't put a nofollow tag on the pages since this will cause a loss of pagerank. The pagerank will flow into the pages and won't flow out to your "doindex" pages when a nofollow tag is used.I do recommend to use a noindex to avoid duplicate content. However you won't get a penalty when you index the pages (if not to spammy). Google might ignore your "duplicate content" pages but you also could gain some traffic.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Lost SEO contract, new SEO wants us to do the following - can you explain why?
1. Make prokem.co.uk the master domain rather than prokem-corrosion-protection.com 2. Ensure each http URL is 301 redirected to its https counterpart via htaccess rather than in plesk 3. 301 redirect each www.prokem-corrosion-protection.com URL to its co.uk counterpart via htaccess. I can provide a list of pages to redirect as there are a number of duplicate pages that will need removing. It probably makes sense to implement these other changes at the same time: Remove all of the canonical tags currently on the site. Leverage browser caching by following Google’s page speed recommendations - https://developers.google.com/speed/docs/insights/LeverageBrowserCaching Losslessly compress all of the website’s images. Combine and minify the website’s JavaScript
On-Page Optimization | | Simon_VO0 -
Internal links are not indexed of the website
Some internal links are indexed and some not of the same page of the website, what is the so and what is the reason behind?
On-Page Optimization | | renukishor10 -
Links in my website are indexed as separate pages
Hi All, We have pages which has names of people which we have created a Alink when clicked it goes to the related persons name. Now Google has indexed it as a seperate page example www.xyz.com/person/name www.xyz.com/person/name?alinks Now the same page is seen in google 2 times. How can i handle this please
On-Page Optimization | | jomin740 -
Wordpress photo blog with sparse text - noindex posts, index categories?
Hi everyone, I have a wordpress blog that is heavy on photos but short on text - most of my posts consist of a photo linking to a full gallery, and a short description of 1-4 sentences. I've often read recommendations to noindex category pages, but in this case I'm wondering if it might be best to noindex the individual posts instead - I'm concerned that the short posts might seem like thin content to Google compared to the category pages which aggregate the posts. Also, some of my categories reflect keywords that I'd like to rank well for. I have about a dozen categories and close to 1000 posts.
On-Page Optimization | | matt_b0 -
When You Add a Robots.txt file to a website to block certain URLs, do they disappear from Google's index?
I have seen several websites recently that have have far too many webpages indexed by Google, because for each blog post they publish, Google might index the following: www.mywebsite.com/blog/title-of-post www.mywebsite.com/blog/tag/tag1 www.mywebsite.com/blog/tag/tag2 www.mywebsite.com/blog/category/categoryA etc My question is: if you add a robots.txt file that tells Google NOT to index pages in the "tag" and "category" folder, does that mean that the previously indexed pages will eventually disappear from Google's index? Or does it just mean that newly created pages won't get added to the index? Or does it mean nothing at all? thanks for any insight!
On-Page Optimization | | williammarlow0 -
How do you optimize for keyword phrases that don't follow natural speech patters?
For instance, We have a phase "solar panels for home" that sends decent traffic to our site, but I'm sure we could be capturing more if any of our content was optimized better for it. But how do you optimize for a phrase that makes you sound like a robot if you use it verbatim?
On-Page Optimization | | wreevesc0 -
Index.php getting Duplicate page content.
I am quite new to SEO and have now got my first results. I am getting all my index.php pages returned as Duplicate page content. ie: blue-widgets/index.php
On-Page Optimization | | ivoryred
blue-widgets/ green-widgets/large/index.php
green-widgets/large/ How do solve this issue?0 -
Does Frequency of content updates affect likelyhood outbound links will be indexed?
I have several pages on our website with low pr, that also themselves link to lots and lots of pages that are service/product specific. Since there are so many outbound links, I know that the small amount of PR will be spread thin as it is. My question is, if I were to supply fresh content to the top level pages, and change it often, would that influence whether or not google indexes the underlying pages? Also if I supply fresh content to the underlying pages, once google crawls them, would that guarantee that google considers them 'important' enough to be indexed" I guess my real question is, can freshness of content and frequency of update convince google that the underlying pages are 'worthy of being indexed', and can producing fresh content on those pages 'keep google's interest', so to speak, despite having little if any pagerank.
On-Page Optimization | | ilyaelbert0