Question about duplicate listings on site for product listings.
-
We list products on our site and suspect that we have been hit by Panda as we are duplicating listings across our own site. Not intentionally, we just have multiple pages listings the same content as they fall into multiple categories.
Has anyone else had the same issue and if so how did you deal with it?.. Have you seen a change in results/rankings due to the changes you made?
-
Hello Nick,
It sounds like you're talking about category pages that link to product pages. I do recommend putting unique content on category pages, as they target different phases of a buying cycle (and keywords). For example...
"Blue Widgets" is a top-level category search.
"Blue Widgets for Men" is a category search."Men's V9 Blue Widget" (not the singular use of widget) is most likely a product search.
All three pages types should have their own unique content using keywords specific to that stage of the buying cycle, and displaying content that is useful to that stage of the buying cycle. For example...
"Blue Widgets" ---> Explain how to choose a blue widget. Which sub-category should they check out? Help them decide where to go next. Help them narrow their search.
"Men's Blue Widgets" ---> Explain the difference between brands and perhaps leading models. What are their needs and budget? Which are the high-end, top-of-the-line men's blue widgets, and which are affordable and reliable options, or entry-level widgets? Educate them.
"Men's V9 Blue Widget" ---> Explain the product. What are the features that either set it apart or make it a good value for the money?
The linking strategy can work this way as well. Naturally you're going to be passing pagerank from category pages into sub-categories and into products. This happens naturally on most sites because that is the natural flow of a purchasing path and a logical taxonomy. However you should also be passing pagerank back up if you want to help category pages rank. Enhanced produce descriptions give you an opportunity to do this.
Good luck!
-
Thanks for the detailed response Tom..
We have for example
A = Listings page with brief of all products
linking to B,C,D,E,F,G etc.. which are all specific pages for those products..
The B - G's rank ok for non competitive terms on the page but page's A dont rank so well.
The problem about no indexing A is that I think the other pages will get lost and have importance taken away from them..
Canonical from second pages of A listings yes, but what I was also thinking to do is put some unique content on page A in order to make that page more unique..Any thoughts on that?
-
Hi there
There are a few options here. Both revolve around making sure only version of your product listings is instructed to be indexed, so that you can promote that version via SEO.
The first solution would be to 301 redirect any duplications to one version of your product listings. This is the quickest and most absolute solution to duplicate listings, as it ensures only version of them remains live. However, depending on your CMS, this might not be possible.
The second solution would be to add robots instructions to the duplicate listings that instructs Google not to index those pages. You can do this by either adding code to the page itself or by using a robots.txt file. The code you'd need to add to the tag on the page is - however, if your CMS is producing duplicate URLs but only using one physical page, you may want to avoid this as it could block all versions of the page. In which case, you could add each duplicate URL to your robots.txt file, specifying you'd like to block them from being indexed, such as:
User Agent: *
Disallow: /example-page-1
Disallow: /example-page-2And so on. I like this robots.txt tutorial guide to learn more about how you can do this.
Finally, you could add canonical tags to each page to specify which version of the URL is the one you want to rank and be indexed, which should prevent others from being considered as well. For example, for a product listing page like: http://www.example.com/category-1/product-page-version-1 - if you want that page to be indexed, you will want to add a canonical tag in the of the code that reads:
Now, if that is the only physical web page that exists and your CMS generates additional, duplicate URLs with how it works, you will only need to add that canonical once. However, if other webpages actually exist in your CMS and server, you will need to add the same tag to the other duplicate pages. This basically tells Google and Bing: "Hey, this page is a duplicate, ignore this one and rank this one instead". Moz has a great guide on canonical usage here.
Dr. Pete also wrote a guide guide on canonical usage and how you can use it for products that are pretty much the same, but have slight differences such as sizes, colour etc.
I hope this helps answer your question - remember, the key here is to instruct Google that you don't want them to index the duplicates and that you don't have them to manipulate rankings. You're trying to have only one version indexed, and if others exist outside of redirects, you have instructed which version should be kept and which ones ignored.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Same product in different categories and duplicate content issues
Hi,I have some questions related to duplicate content on e-commerce websites. 1)If a single product goes to multiple categories (eg. A black elegant dress could be listed in two categories like "black dresses" and "elegant dresses") is it considered duplicate content even if the product url is unique? e.g www.website.com/black-dresses/black-elegant-dress duplicated> same content from two different paths www.website.com/elegant-dresses/black-elegant-dress duplicated> same content from two different paths www.website.com/black-elegant-dress unique url > this is the way my products urls look like Does google perceive this as duplicated content? The path to the content is only one, so it shouldn't be seen as duplicated content, though the product is repeated in different categories.This is the most important concern I actually have. It is a small thing but if I set this wrong all website would be affected and thus penalised, so I need to know how I can handle it. 2- I am using wordpress + woocommerce. The website is built with categories and subcategories. When I create a product in the product page backend is it advisable to select just the lowest subcategory or is it better to select both main category and subcategory in which the product belongs? I usually select the subcategory alone. Looking forward to your reply and suggestions. thanks
Intermediate & Advanced SEO | | cinzia091 -
How bad is duplicate content for ecommerce sites?
We have multiple eCommerce sites which not only share products across domains but also across categories within a single domain. Examples: http://www.artisancraftedhome.com/sinks-tubs/kitchen-sinks/two-tone-sinks/medium-rounded-front-farmhouse-sink-two-tone-scroll http://www.coppersinksonline.com/copper-kitchen-and-farmhouse-sinks/two-tone-kitchen-farmhouse-sinks/medium-rounded-front-farmhouse-sink-two-tone-scroll http://www.coppersinksonline.com/copper-sinks-on-sale/medium-rounded-front-farmhouse-sink-two-tone-scroll We have selected canonical links for each domain but I need to know if this practice is having a negative impact on my SEO.
Intermediate & Advanced SEO | | ArtisanCrafted0 -
Internal Duplicate Content Question...
We are looking for an internal duplicate content checker that is capable of crawling a site that has over 300,000 pages. We have looked over Moz's duplicate content tool and it seems like it is somewhat limited in how deep it crawls. Are there any suggestions on the best "internal" duplicate content checker that crawls deep in a site?
Intermediate & Advanced SEO | | tdawson091 -
Why is this url redirecting to our site?
I was doing an audit on our site and searching for duplicate content using some different terms from each of our pages. I came across the following result: www.sswug.org/url/32639 redirects to our website. Is that normal? There are hundreds of these url's in google all with the exact same description. I thought it was odd. Any ideas and what is the consequence of this?
Intermediate & Advanced SEO | | Sika220 -
Troubled QA Platform - Site Map vs Site Structure
I'm running a Q&A forum that was built prioritizing UX over SEO. This decision has cause a bit of a headache as we're 6 months into the project with 2278 Q&A pages with extremely minimal traffic coming from search engines. The structure has the following hiccups: A. The category navigation from the main Q&A page is entirely javascript and only navigable by users. B. We identify Google bots and send them to another version of the Q&A platform w/o javascript. Category links don't exist in this google bot version of the main Q&A page. On this Google version of the main Q&A page, the Pinterest-like tiles displaying individual Q&As are capped at 10. This means that the only way google bot can identify link juice being passed down to individual QAs (after we've directed them to this page) is through 10 random Q&As. C. All 2278 of the QAs are currently indexed in search. They are just indexed very very poorly in SERPs. My personal assumption, is that Google can't pass link juice to any of the Q&As (poor SERP) but registers them from the site map so it gets included in Google's index. My dilemma has me struggling between two different decisions: 1. Update the navigation in the header to remove the javascript and fundamentally change the look and feel of the Q&A platform. This will allow Google bot to navigate through Expert category links to pass link juice to all Q&As. or 2. Update the redirected main Q&A page to include hard coded category links with 100s of hard coded Q&As under each category page. Make it similar, ugly, flat and efficient for the crawling bots. Any suggestions would be greatly appreciated. I need to find a solution as soon as possible.
Intermediate & Advanced SEO | | TQContent0 -
Duplicate Content/ Indexing Question
I have a real estate Wordpress site that uses an IDX provider to add real estate listings to my site. A new page is created as a new property comes to market and then the page is deleted when the property is sold. I like the functionality of the service but it creates a significant amount of 404's and I'm also concerned about duplicate content because anyone else using the same service here in Las Vegas will have 1000's of the exact same property pages that I do. Any thoughts on this and is there a way that I can have the search engines only index the core 20 pages of my site and ignore future property pages? Your advice is greatly appreciated. See link for example http://www.mylvcondosales.com/mandarin-las-vegas/
Intermediate & Advanced SEO | | AnthonyLasVegas0 -
What happened to my site?
This is my website: http://goo.gl/Brekn It was related to health niche. I am good with the serp for the last couple of hours. I am in top for the keywords: cure for piles, hemorrhoids treatment, natural hemorrhoid treatment. My main keyword is hemorrhoids treatment. And has recently added this page, http://goo.gl/SXNtX This page has some dupe content, as content writer was busy i have copied the content from other sources. Does this have any effect? I have not added this page onto homepage as i dont like google to index it until my copywriter writes the content. Dont know what happened, in the last few hours i lost my serp to no where. Can anyone tell me what happened to my site. Did i done anything wrong? In the last week i have added a link to my ebooks related site. Does this affected my serps? Or did the Google recent change http://googlewebmastercentral.blogspot.com/2012/01/page-layout-algorithm-improvement.html Has any effect on my site? Awaiting for your replies...
Intermediate & Advanced SEO | | Dex324344320 -
Avoiding duplicate content on an ecommerce site
Hi all, I have an ecommerce site which has a standard block of text on 98% of the product pages. The site also has a blog. Because these cause duplicate content and duplicate title issues respectively, how can I ever get around this? Would having the standard text on the product pages displayed as an image help? And how can I stop the blog being listed as duplicate titles without a nofollow? We already have the canonical attribute applied to some areas where this is appropriate e.g. blog and product categories. Thanks for your help 🙂
Intermediate & Advanced SEO | | CMoore850