Solved Duplicate content error affecting 142 pages
-
Hello,
Recently I noticed a new duplicate error notification.
This page: https://www.earley.com/insights/internet-things-and-product-data
is flagged as 'duplicate content' with 142 affected pages.
Here's an example of one of the affected pages:
https://www.earley.com/insights/how-ontologies-drive-digital-transformation
This is not an ecommerce site. The affected pages are blog posts. We are pretty prolific writers and over the years we have produced nearly 300 articles. We are a consulting firm and the articles are about our area of expertise and cover a wide range of topics within that space.
I just don't understand why this would be flagged as duplicate or what I'm supposed to do with this information!
Help!
Thanks!
Sharon -
@meghanpahinui said in Duplicate content error affecting 142 pages:
@eismarketing Hi Sharon!
Thanks so much for the great question! And so sorry for any confusion here.
Pages that are flagged as duplicate content are being assessed on the source code of those pages and not just the content on the page itself. Since it's not based purely on the written content of the page, this means if you're using a template of some kind or all your pages have a similar structure, they may end up being flagged as duplicate content. Pages can be marked as duplicates of each other when there isn't enough unique content on each page to distinguish them from each other.
The Moz tools have a 90% threshold for duplicate content so any pages with at least 90% of the same code will be flagged as duplicates of one another.
I've grabbed a few resources that may help:
Here is a Whiteboard Friday about duplicate content and some ways you can resolve it.
Here is an article from the Moz Learning Center regarding duplicate content.
Here is some information from Google re: duplicate content as well.At time of answering your query, you won't get a penalty for duplicate content, however anything you can do to help search engines understand what you content is about and to create value for your visitors, will support a strong content marketing and SEO strategy.
-
@eismarketing Hi Sharon!
Thanks so much for the great question! And so sorry for any confusion here.
Pages that are flagged as duplicate content are being assessed on the source code of those pages and not just the content on the page itself. Since it's not based purely on the written content of the page, this means if you're using a template of some kind or all your pages have a similar structure, they may end up being flagged as duplicate content. Pages can be marked as duplicates of each other when there isn't enough unique content on each page to distinguish them from each other.
The Moz tools have a 90% threshold for duplicate content so any pages with at least 90% of the same code will be flagged as duplicates of one another.
I've grabbed a few resources that may help:
Here is a Whiteboard Friday about duplicate content and some ways you can resolve it.
Here is an article from the Moz Learning Center regarding duplicate content.
Here is some information from Google re: duplicate content as well.At time of answering your query, you won't get a penalty for duplicate content, however anything you can do to help search engines understand what you content is about and to create value for your visitors, will support a strong content marketing and SEO strategy.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Using same copy on different domain
I have a client that currently has a .com domain (not using hreflang) . They have a new partner in the UK and they want to replicate the website and use a .co.uk domain. It will be a different brand name. Will this cause any SEO issues?
Intermediate & Advanced SEO | | bedynamic0 -
Is it Ok to have multiple domains (separate website different content) rank for similar keywords?
Is it 'OK' to have multiple domains in the following instance? Does Google actively discourage multiple (but completely different sites) domains from the same company appearing in the search results for the same and or similar keywords if the content is slightly different? This is where the 'main site' has the details, and you can purchase product, and the second site is a blog site only. We are creating a separate content blogsite; which would be on a second domain that will be related to one portion of content on main site. They would be linking back and forth, or maybe the blog site would just link over to the main site so they can purchase said product. This would be a similar scenario to give you an idea of how it would be structured: MAIN SITE: describes a few products, and you can purchase from this site SECOND SITE, different domain: a blog site that contains personal experiences with one of the products. BOTH sites will be linked back and forth....or as mentioned maybe the blog site could just link over to the 'main site' Logo would be a modified version of the main logo and look and feel of the sight would be similar but not exactly the same. MORE INFO: the main site has existed for way over 10 years, starting to gain some traction in an extremely competitive market, but does not rank super high, is gaining traction due to improvements in speed, content, onpage SEO, etc... So in addition to my main question of is this 'ok' to have this second domain, also will it hurt the rankings or negatively affect the 'main' site? Wondering about duplicate content issues, except it will be slightly different...
SEO Tactics | | fourwhitesocks0 -
Unsolved Monitor on page changes
Is it possible to monitor on page changes with Moz? Let's say the description of product x is changed, I would know somehow. It could be title, image, meta desc, etc.
Product Support | | Displetech0 -
Can you use no-index to counter duplicate content across separate domains?
Hi Moz Community, I have a client who is splitting out a sub brand from a company website to its own domain. They have lots of content around the theme and they want to migrate most of the content out to the new domain, but they also wanted to keep that content on the main site as the main site gets lots of traffic. My question is, as they want search traffic to go to the new site, but want to keep the best content on the original site too, so it can be found in the nav, if they no-index identical content on main site and index content on the new site will they still be penalised for duplicate content? Our advice has been to keep the thematic content on both sites but make them different enough so they are not considered duplicate - we routinely write the same blog post in 50 different ways for them but their Head of Web asked if the no-index is a route, which means they don't need to pay for and wait for brand new content? They are comfortable in losing traffic until the new domain gets traction. In theory, if they are telling Google not to index or rank the main site content, the new site shouldn't be penalised but I'm not confident giving that advice as I've never been asked to do this before. Thoughts?
Technical SEO | | Algorhythm_jT0 -
Plagiarized Site Effecting Google Rankings
Can someone provides insights on a de-indexing example? I have gone through the depths of Google lack of support and requesting duplicate content flags, so no avail. Here's the scenario: Client had a competing SEO provider try to earn his business. In doing so, he copied word for word our blog that we have been producing content on over the last 5 years. He also integrated Google reviews in the structured data on this new URL. Well, fast forward 1-2 months later, our rankings started to drop. We found this 100% plagiarized site is taking away from our keyword rankings on GMB, and is no and Google search, and our site GMB is now only displaying on a branded name search as well as our search traffic has dropped. I have identified the plagiarized, duplicated content, being tied to our GMB as well, as the source of the problem. Well, I finally obtain ed control of the plagarized domain and shut down the hosted, and forwarded the URL to our URL. Well, Google still has the HTTS version of the site indexed. And it is in my professional opinion, that since the site is still indexed and is associated with the physician GMB that was ranking for our target keyword and no longer does, that this is the barrier to ranking again. Since its the HTTPS version, it is not forwarded to our domain. Its a 504 error but is still ranking in the google index. The hosting and SSL was canceled circa December 10th. I have been waiting for Google to de-index this site, therefore allowing our primary site to climb the rankings and GMB rankings once again. But it has been 6 weeks and Google is still indexing this spam site. I am incredibly frustrated with google support (as a google partner) and disappointed that this spam site is still indexed. Again, my conclusion that when this SPAM site is de-indexed, we will return back to #1. But when? and at this point, ever? Highlighted below is the spam site. Any suggestions? Capture.PNG
SEO Tactics | | WebMarkets0 -
On page SEO Report Sucks
Hey. I'm trying to get a PDF of the on page report so I can see a list of each issue. This works well if you're logged in and just navigate through the different tabs, but not so well if you export. All I get is an overview of the number of the priority issues, but not the URLs and the specific problems. I know you can export a CVS, but that's not a very good branded way to export this. What I'd like to do is export a report that is fairly gainular so I can provide "before and after" reports for work we completed. As is stands now, I have an overview PDF which sucks and can't provide any more details or a CVS which has all the details in the world, but is so in depth it's hard to navigate, especially for clients who don't know what they're looking at, not to mention it's not branded!!! There should be way more options for reporting here. Please let me know if you can do something about this or if I'm just missing something. Thanks. Micha
Product Support | | Multiverse-Media-Group0 -
How do I stop these duplicate reports being emailed?
It used to be that I received just one weekly report per campaign when using MozPro. Over the last couple of weeks/month (since creating MozAnalytics reports) I've started to receive 2 reports for the same campaign...with no different whatsoever, apart from the time that they have been sent. I've been back into the old MozPro campaigns and deleted any automated reports that were being generated there, and so now I should have just one weekly MozAnalytics report from each campaign. Has anyone had this problem before and do they know how to fix it? Getting really annoying, especially with 13 campaigns resulting in 26 emails! Thanks
Product Support | | bricktech0 -
Duplicate Content Report: Duplicate URLs being crawled with "++" at the end
Hi, In our Moz report over the past few weeks I've noticed some duplicate URLs appearing like the following: Original (valid) URL: http://www.paperstone.co.uk/cat_553-616_Office-Pins-Clips-and-Bands.aspx?filter_colour=Green Duplicate URL: http://www.paperstone.co.uk/cat_553-616_Office-Pins-Clips-and-Bands.aspx?filter_colour=Green**++** These aren't appearing in Webmaster Tools, or in a Screaming Frog crawl of our site so I'm wondering if this is a bug with the Moz crawler? I realise that it could be resolved using a canonical reference, or performing a 301 from the duplicate to the canonical URL but I'd like to find out what's causing it and whether anyone else was experiencing the same problem. Thanks, George
Product Support | | webmethod0