How Do You Deal With Duplicate Content On A Retail Site
-
Hi Guys
We make custom portfolios and boxes and every time we have a Moz site crawl, Rogerbot always returns a number of Duplicate Content Issues relating to different products.
As per the image below (which I hope is visible?!) Rogerbot has flagged duplicate content onto one product that relates to 5 other different products. For instance there is duplicate content for an A4 Leather Portfolio and an A3 Leather Portfolio and an 11"x17" Leather Portfolio. I can't redirect or canonicalise to just the A4 Portfolio as they are all individually different products.
The information on each page although similar, is relevant to each of the products, so rewriting a different blurb on each product page, will not be user friendly for our customers.
I could ignore the duplicate content issues, but then that isn't good practise (and also makes for a very unsatisfactory looking Dashboard!)
Any ideas??
Nick
-
Hi Tawny
Thanks very much, as it happens Nigel has posted a response that'll hopefully solve the issue and Roman has given me food for thought on another issue we have brewing.
Best Regards
Nick
-
Hi Nigel
Yet again, my thanks! A bit of a re-make, but it will be well worth it. Ironically, having sizes as attributes is something we used to do and was something that we thought we should go back to, so that's answered that question!
Thanks also for the advice re the tags.
Best Regards (and thanks again)
Nick
-
I agree with Nigel on this. It is easier then creating different content for each variation.
-
Hi There,
I work with a lot of eCommerce sites and Roman's answer is great when the problem is to have the same product in colour or size variations.
You just set up one page:
site/leather-portfolio
This is a single product in sizes A3, A4 and 11"x17. create a page with the URL as shown then have 'attributes' on the page for sizes. Typically the attribute will be held behind a # or similar so will not be indexable. The canonical would just be site/leather-portfolio and the three sizes would be in the form of a drop down or swatches on a single page. Combine all of the text you would have spread over the pages on to this one making it super smart for SEO
Also, make sure that tags are non-indexable or canonicalized otherwise those sizes may append themselves to multiple URLs causing endless duplication.
Regards Nigel
-
Hey there! Tawny from Moz's Help Team here.
Shoot! You've already ruled out the only suggestions I have: either using the canonical tag to tell search engines (and our crawler) which version of the page has the best info on it and should rank highest, or add in some extra content on each page to differentiate them from one another.
Our tool has a 90% tolerance for duplicate content, meaning it'll flag anything that's 90% similar or more at the source code level, not just the viewable text on the page. In order to stop getting these duplicate content issues, you'll need to find some way of making each of those pages different enough from one another that they're not fighting each other for rankings anymore.
If you don't want to add a canonical tag or more text to the pages, the last option would be to just Ignore the issue in your Dashboard. If you do that, we'll stop reporting duplicate content issues for those pages going forward—we'll just ignore that class of issue for those pages. It won't fix the issue for search engines, but it would help you clean up your Moz Pro Dashboard.
I know that's not super helpful—I really wish I had some better advice to offer! Maybe one of our esteemed community members will have a suggestion for you that'll do the trick. If you want to follow up or have more questions for us, feel free to reach out to help@moz.com and we'll do our best to answer all your questions.
-
A Good option for dealing with duplicate content is to use the rel=canonical attribute. This tells search engines that a given page should be treated as though it were a copy of a specified URL, and all of the links, content metrics, and "ranking power" that search engines apply to this page should actually be credited to the specified URL.
Lets take an Iphone7 as example, you have one product with differents option 64GB, 128GB with 3 color variations, so you create a "master page" in simple words you should create some master page where you put all your seo efforts and tell the crawler ignore the other ones
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
WP Events Calendar Creates URLs Too Long in Site Crawler
My travel/tourism site is on WP and using an Events plugin that ads a calendar of events to many pages. The MOZ crawler is indexing almost 46K links with a URL too long, but the site only has about 3.8K pages indexed in Google. I can tell MOZ is indexing the same pages over and over again but just adding a random calendar month and year. Here are some examples. https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country[0]=US&ajaxCalendar=1&mo=10&yr=2003 https://www.visitcurrituck.com/four-day-stay/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=10&yr=2034 https://www.visitcurrituck.com/beach-houses-family-time/?full=1&long_events=1&country%5B0%5D=US&ajaxCalendar=1&mo=1&yr=1873 Any advice on how to prevent MOZ from indexing this way? I don't believe that Google is seeing this also, but maybe they are. I just know my site has over 63K issues and I'm sure at least 75% or more is because of the way they are picking up on the events calendar. Thanks!
Link Explorer | | CinivaAgency1 -
Difference on full and partial URLs in Open Site Explorer?
Hi, I am pretty new to SEO and it might show. Here is my question, regarding the difference on "full and partial" urls in Open Site Explorer (OSP). That is, the difference on http://www.mywebsite.com and http://mywebsite.com. I get very similar results for the two variations, but not exactly the same. That suggest to me that OSP most of the time find the same links regardless of whether the url put into the search field is full or partial. But not all the time. Can anyone clarify? Thx in advance
Link Explorer | | plovski0 -
How can I get links indexed in Just Discovered Links, or Open site Explorer? (Because it aint Bit.ly or Feedly!)
Dear Moz & Forum, I've been on a bit of a merry-go-round with one of my clients. He knows enough about SEO to ask questions, and one thing he likes is to see the links that we are building inside Open Site Explorer. Now, of course we know that it takes a while for links to show, but that was ok, because we could just plug the links that we've built into a bit.ly link and then they'd show under Just Discovered Links in Open Site Explorer, and then boom, we're happy. It stopped working some time ago, and after the support team were a little unstuck I sent a hopeful tweet to @randfish. Here is the response: https://twitter.com/randfish/status/788412272129347584 The advice to use Bit.Ly was removed swiftly after this! Oops! The current Guidance is here: https://moz.com/help/guides/research-tools/open-site-explorer/justdiscovered It says: Want to see your new link in the Just-Discovered Links tab? An easy way to start seeing your link in the Just-Discovered section is to have it shared on Twitter and available on Feedly link. Feedly stopped supporting their own link shortner a few years ago. Also, when you share a link from Feedly on twitter it is just the same as sharing a normal tweet, because it shares the standard URL for the site not a link to view on Feedly. Or, maybe these two statements are independant of one another and they should both be done separately? I've done that too! I've also added the feed to recommended feeds inside fresh web explorer and that didn't work either! So, Moz and Help team please help me! How can I get links I've built for clients into Just Discovered Links? Thank you!
Link Explorer | | stevestretton11 -
Backlinks not showing on Open Site Explorer's Just-Discovered Links
Hi guys! My name is Edgar. I've recently been adding a bunch of backlinks to the site i work for, and most of them have a very high DA (DA > 80. Wohoo!). Nevertheless i'm often feel a bit frustrated when i check my site with the OSE, because just a few part of these links are showed in the just-discovered section, although i created them few days ago. So, i would like to know why is this happening, how long it take for my links to get crawled, and when can i stop getting frustrated on this? Than you very much! Edgar.
Link Explorer | | PCBU0 -
Learn how to use Open Site Explorer's Just-Discovered Links report to build links and manage your brand. Get your Daily SEO Fix!
The Just-Discovered Links report in Open Site Explorer helps you discover recently created links--within an hour of them being published. It's pretty nifty. In today's Daily SEO Fix, Nick shows you how to use the report to view who is linking to you, how they're doing it, and what they are saying so you can capitalize on link opportunities while they're still fresh plus, monitor and participate in the conversations happening about your brand. Watch our tutorial Using Open Site Explorer to Find Fresh Links and Manage Your Brand Online and get ready to dive in! This video is part of The Moz Daily SEO Fix tutorial series--Moz tool tips and tricks in under 2 minutes. To watch all of our videos so far, and to subscribe to future ones, make sure to visit the Daily SEO Fix channel on YouTube.
Link Explorer | | kellyjcoop3 -
Why does the number of the total external links and the followed linking root domains between Open site explorer and the campaign in Moz pro doesn't match?
Opensiteexplorer returns 52.473 total external links and 715 followed linking root domains while my campaign in Moz analytics return 35.899 total external links and 1092 followed linking root domains. Does anyone knows how this is possible?
Link Explorer | | ConversionMobstars0 -
Links from no-indexed pages in Open Site Explorer
I just looked up a site in Open Site Explorer. After putting in the site, I get a list of domains, links etc which is very useful. At the bottom is a note which I have pasted below. It mentions "24 links from no-indexed pages" and says we can't get any info on these. Is there a way to see what the 24 links are so I can investigate further?"Why does my number of inbounds links listed not match my total links count? The listed number may be slightly different because we only show 25 links per domain (so that you see a variety). Additionally you have 24 links from no-indexed pages. Unfortunately, we can't get info for those links."
Link Explorer | | EdKim0 -
Is there an efficient way to use Open Site Explorer to find unnatural or harmful links
We have a new client with 8 sites that we would like to 301 to a new site. However, before doing so we want to make sure that the backlinks are not unnatural or harmful in any way. Using open site explorer (other than just looking at exact anchor text vs brand anchor text ratio) is there a way to determine low quality inbound sites linking in? or any type of links google will find manipulative?
Link Explorer | | Bryan_Loconto0