Duplicate Content Mystery
-
Hi Moz community!
I have an ongoing duplicate mystery going on here and I'm hoping someone here can answer my question.
We have an Ecommerce site that has a variety of product pages and category pages. There are Rel canonicals in place, along with parameters in GWT, and there are also URL rewrites.
Here are some scenarios, maybe you can give insight as to what’s exactly going on and how to fix it.
All the duplicates look to be coming from category pages specifically.
For example:
This link re-writes:To:
http://www.incipio.com/cases/tablet-cases/amazon-kindle-cases-sleeves.html
The rel canonical tag looks like this:
http://www.incipio.com/cases/tablet-cases/amazon-kindle-cases-sleeves.html" />
The CONTENT is different, but the URLs are the same. It thinks that the product category view is the same as the all products view, even though there is a canonical in there telling it which one is the original. Some of them don’t have anything to do with each other.
Take a look:
Link identified as duplicate:
Link this is a duplicate of:
http://www.incipio.com/cases/macbook-cases/macbook-pro-13in-cases.html
Any idea as to what could be happening here?
-
Hi Ishwar,
If you have done so yet it would be best to create your own post. Many people pop in here to help others and when they see this topic as answered they may not look at it. Creating your own post will get the most attention.
-
Hi Nicole,
Okay so the reason I stated that it appears something is improperly installed is due to the fact a page should in general have 1 head tag, 1 title tag, 1 body tag and 1 document type declaration. Your page has the normal ones you'd expect to see plus another set.
In the code I posted above you have an Iframe, which is basically a tag that says display information from a different source. In this case it is Google, which is fine but it should not contain another set of head, title, and body tags along with a document declaration. Google would never do that. This along with my years of experience looking at and installing ad-ons leads me to believe that something was installed incorrectly or at the very least not coded correctly.
As to the misconfiguration issue, I would look first at how my url rewrites are being done as there is no viable reason the first link you posted should rewrite to a url and serve different content than what is suppose to be there. That tells me that the re-writes are being incorrectly handled.
I hope that helps a little,
Don
-
Hello Moz Communtiy!
i am also having error of Duplicate Tag Content Mystery like:
http://www.earnmoneywithgoogleadsense.com/tag/blog-post/
http://www.earnmoneywithgoogleadsense.com/tag/effective-blog-post/
Pages are same. I have 100+ Error on website so how can i remove this error? DO you have any tutorial based on this?
Can i change canonical url at once or i need to set it one by one
-
Hi Donford,
Thanks so much for getting back to me. Great answer! I'd like some clarification here. I did not configure this and if I'm going to talk to the developer, I'd like to have more knowledge to speak to it.
Could you please clarify what you mean when you say:
- It looks like something is installed and configured improperly.
- You have 2 head tags on the page that shows up from the redirect.
- This is actually inside the first head tag complete with a body tag and another doc declaration.
I looked at the example you sent, but I'm not sure what I'm looking at. If you could explain those bullet points in more detail, it would greatly help.
You're the best!
Thanks,
Nicole
-
It looks like something is installed and configured improperly.
You have 2 head tags on the page that shows up from the redirect.
This is actually inside the first head tag complete with a body tag and another doc declaration.
<iframe id="oauth2relay579972146" name="oauth2relay579972146" src="https://accounts.google.com/o/oauth2/postmessageRelay?parent=http%3A%2F%2Fwww.incipio.com#rpctoken=728288212&forcesecure=1" style="width: 1px; height: 1px; position: absolute; top: -100px;" tabindex="-1">
<html><head><title>title><meta content="text/html; charset=utf-8" http-equiv="content-type"><meta content="IE=edge" http-equiv="X-UA-Compatible"><meta content="width=device-width, initial-scale=1, minimum-scale=1, maximum-scale=1, user-scalable=0" name="viewport"><script src="https://apis.google.com/js/api.js" type="text/javascript" gapi_processed="true"><script src="https://oauth.googleusercontent.com/gadgets/js/core:rpc:shindig.random:shindig.sha1.js?c=2" type="text/javascript"><script src="https://ssl.gstatic.com/accounts/o/3417060037-postmessagerelay.js">head><body>html>iframe>
That looks like an installation issue.
-
Now the misconfiguration issue would have to be why the URL re-writes to page but serves up different content.
-
And lastly I think even if you fix those issues you're still going to get duplicate content warnings because you have very thin content on pages.
-
Example: Page 1 http://www.incipio.com/cases/tablet-cases/amazon-kindle-cases-sleeves/amazon-kindle-fire-hd-6-cases.html
-
Example: Page 2 http://www.incipio.com/cases/tablet-cases/amazon-kindle-cases-sleeves/amazon-kindle-fire-hd-7-cases.html
-
On those 2 pages there is a 1 character difference 6 instead of 7. All the other content (header & footer) and 1 letter difference. Than if you go to the actual product page you have the exact same issue same description to the letter except the one number. Yep, you're going to have a duplicate content problem.
-
This is something that all e-commerce stores face. You honestly need to write unique content for each and every product you sell. Don't copy & paste stuff from another site like Amazon or the manufacturers site, write your own content.
-
In summation, I would recheck any modules/ad-ons/plug-ins you installed as one appears to be incorrect. if that doesn't' fix the re-write issue have a developer that is familiar with your ecommerce platform look at this issue. Lastly, you got to have unique content.
-
Maybe not the best news but I hope it helps
-
Don
Edit in bullet points to try and make the post a look a little better. These forums don't take kindly to adding code blocks
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate Footer Content Issue
Please check given screenshot URL. As per the screenshot we are using highlighted content through out the website in the footer section of our website (https://www.mastersindia.co/) . So, please tell us how Google will treat this content. Will Google count it as duplicate content or not? What is the solution in case if the Google treat it as duplicate content. Screenshot URL: https://prnt.sc/pmvumv
Technical SEO | | AnilTanwarMI0 -
Best way to fix duplicate content issues
Another question for the Moz Community. One of my clients has 4.5k duplicate content issues. For example: http://www.example.co.uk/blog and http://www.example.co.uk/index.php?route=blog/blog/listblog&year=2017. Most of the issues are coming from product pages. My initial thoughts are to set up 301 redirects in the first instance and if the issue persists, add canonical tags. Is this the best way of tackling this issue?
Technical SEO | | Laura-EMC0 -
Best Way to Handle Near-Duplicate Content?
Hello Dear MOZers, Having duplicate content issues and I'd like some opinions on how best to deal with this problem. Background: I run a website for a cosmetic surgeon in which the most valuable content area is the section of before/after photos of our patients. We have 200+ pages (one patient per page) and each page has a 'description' block of text and a handful of before and after photos. Photos are labeled with very similar labels patient-to-patient ("before surgery", "after surgery", "during surgery" etc). Currently, each page has a unique rel=canonical tag. But MOZ Crawl Diagnostics has found these pages to be duplicate content of each other. For example, using a 'similar page checker' two of these pages were found to be 97% similar. As far as I understand there are a few ways to deal with this, and I'd like to get your opinions on the best course. Add 150+ more words to each description text block Prevent indexing of patient pages with robots.txt Set the rel=canonical for each patient page to the main gallery page Any other options or suggestions? Please keep in mind that this is our most valuable content, so I would be reluctant to make major structural changes, or changes that would result in any decrease in traffic to these pages. Thank you folks, Ethan
Technical SEO | | BernsteinMedicalNYC0 -
Duplicate Content in Wordpress.com
Hi Mozers! I have a client with a blog on wordpress.com. http://newsfromtshirts.wordpress.com/ It just had a ranking drop because of a new Panda Update, and I know it's a Dupe Content problem. There are 3900 duplicate pages, basically because there is no use of noindex or canonical tag, so archives, categories pages are totally indexed by Google. If I could install my usual SEO plugin, that would be a piece of cake, but since Wordpress.com is a closed environment I can't. How can I put a noindex into all category, archive and author peges in wordpress.com? I think this could be done by writing a nice robot.txt, but I am not sure about the syntax I shoud use to achieve that. Thank you very much, DoMiSol Rossini
Technical SEO | | DoMiSoL0 -
Duplicate content - font size and themes
Hi, How do we sort duplicate content issues with: http://www.ourwebsite.co.uk/ being the same as http://www.ourwebsite.co.uk/StyleType=SmallFont&StyleClass=FontSize or http://www.ourwebsite.co.uk/?StyleType=LargeFont&StyleClass=FontSize and http://www.ourwebsite.co.uk/legal_notices.aspx being the same as http://www.ourwebsite.co.uk/legal_notices.aspx?theme=default
Technical SEO | | Houses0 -
Is Noindex Enough To Solve My Duplicate Content Issue?
Hello SEO Gurus! I have a client who runs 7 web properties. 6 of them are satellite websites, and 7th is his company's main website. For a long while, my company has, among other things, blogged on a hosted blog at www.hismainwebsite.com/blog, and when we were optimizing for one of the other satellite websites, we would simply link to it in the article. Now, however, the client has gone ahead and set up separate blogs on every one of the satellite websites as well, and he has a nifty plug-in set up on the main website's blog that pipes in articles that we write to their corresponding satellite blog as well. My concern is duplicate content. In a sense, this is like autoblogging -- the only thing that doesn't make it heinous is that the client is autoblogging himself. He thinks that it will be a great feature for giving users to his satellite websites some great fresh content to read -- which I agree, as I think the combination of publishing and e-commerce is a thing of the future -- but I really want to avoid the duplicate content issue and a possible SEO/SERP hit. I am thinking that a noindexing of each of the satellite websites' blog pages might suffice. But I'd like to hear from all of you if you think that even this may not be a foolproof solution. Thanks in advance! Kind Regards, Mike
Technical SEO | | RCNOnlineMarketing0 -
How do I fix duplicate content with the home page?
This is probably SEO 101, but I'm unsure what to do here... Last week my weekly crawl diagnostics were off the chart because http:// was not resolving to http://www...fixed that but now it's saying I have duplicate content on: http://www.......com http://www.......com/index.php How do I fix this? Thanks in advance!
Technical SEO | | jgower0 -
Google Duplicate Content Penalty On My Own Site?
I am certain that I have hit a google penalty filter for my site http://www.playpokeronline.ca for my main keywords "play poker online" in google.ca I rank 670th and used to be on the first page between 1 and 10 in June. On Bing I am like 9th On my site I found the entire site duplicated as follows Original: www.playpokeronline.ca Duplicate www.playpokeronline.ca/playpokeronline/ this duplicate was not intentional and seems to be a result of my hosting at godaddy. for every page on my site and it shows up in webmaster tools I blocked the duplicate with robots.txt and a few days ago dropped it and wrote a rel=connonical tag in the top of each page visitors dropped from 100 per day in august to 12-20 in the last month. Google says that if duplicate content is made to try to game serps they may filter or penalize my site. Have I triggered this penalty or a different sort of over optimization penalty? Will the rel= canonical tags fix this or should i do something else? This Penalty Business is Not my Idea of a good time Thank You Jeb
Technical SEO | | PokerCanada0