Perplexed by last MOZ crawling duplicate content errors
-
In the last crawler issues report from MOZ I can see many many pages listed as duplicate content with 0 duplicate urls.
Like this: http://imgur.com/fbikRVq
I am puzzled, what does it mean?
-
Even in the last crawl report the bug is still there, any idea when it will be fixed?
-
Thanks for the answer/update.
-
Hi Max and Doug - this is currently being recognized as a bug and we have it currently being worked on as we speak. Sorry for the confusion in the short term!
-
We have not had that happen. All the "Duplicate Content" items list a number of duplicates that's > 0.
It is possible that Moz is buggy.
-
But was your report showing the list of url considered duplicate of that url?
In my case on the right I have the duplicate url, but on the left (where the list of other url the crawler consider duplicate should be) there's written 0 page duplicate, and the list is empty.
I am aware even if two pages looks different to me could be considered duplicate by rogerbot, but in the past it was always showing the number of duplicate pages found and the list of duplicate url.
-
We had the same concern and asked MOZ support this question: Why are we getting duplicate content warnings for pages that are clearly different?
We received the response below. Our takeaway is that we will continue to take these warning into consideration, but apply our own expertise to determine if action is needed.
Response from support: Thanks for reaching out, and sorry for the confusion! Duplicate content is always kind of a tricky issue. While you or I can qualitatively determine that there are differences between these pages, crawlers are dependent on more quantitative means to determine duplicate content. When they view the pages, one part of the process is to examine the similarity of the pages' code and look for close matches to determine duplicates; this appears to be the issue here. I stuck these URLs into a similar page checker (http://www.webconfs.com/similar-page-checker.php), and it indicated that there was quite a high degree of similarity.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Content suggestions
Hello, I am looking at the content suggestions in the page optimisation section and was wondering why the system says that some pages cover some topics and some don't cover it ? Is it based on finding "noun phrases" that co-occurre (twice the same one) ? or "noun phrases" that are used in the same context (even though they are different) ? Thank you,
Moz Bar | | seoanalytics0 -
MOZ crawler 404 errors on wordpress
Hi all, I've got hundreds of issues coming up on the MOZ crawler with 404 errors, I don't know what these URL's are. Here's a couple of examples; http://www.theswagbagco.co.uk/category/watford/http%3A%2F%2Fwww.theswagbagco.co.uk%2F2015%2F10%2F15%2Fnew-products-2%2F
Moz Bar | | vaineh
http://www.theswagbagco.co.uk/2015/10/01/thank-you-epsom/http%3A%2F%2Fwww.theswagbagco.co.uk%2F2015%2F10%2F01%2Fthank-you-epsom%2F See the first one is one page with a different url appended, the second is the same thank-you-epsom url. How would I find out where these are even being linked from?0 -
Duplicate page found with MOZ crawl test?
When I crawl my website www.radiantguard.com, the crawl test comes back with what appears to be a duplicate of my home page: http://www.radiantguard.com and http://www.radiantguard.com/ Does the crawler indeed see two different pages and therefore, are my search engine rankings potentially affected, AND is this because of how my rel canonical is set up?
Moz Bar | | rhondafranklin0 -
Why RogerBot can't crawl site https://unplag.com
Hello Please help me to solve the problem. The on-page grader and Crawl Test are not working for Unplag.com website. Both said that they can't access the url. Yes, I've tried different variants like unplag.com, http://unplag.com One more thing - RogerBot was disallowed in robots.txt file. I deleted it from the file a week ago so maybe moz index haven't been renewed.
Moz Bar | | Targeras0 -
In Moz Medium Pro how many pages can you track for keyword rankings at a time? I know you can track up to 50 in Standard.
I would possibly like to upgrade my subscription from Standard to Medium because I want to be able to track more pages in Rank Tracker. Unfortunately, the product descriptions do not include how many pages you can track in Rank Tracker.
Moz Bar | | VacasaSEM0 -
Crawling password protected sites such as dev or staging areas to look at sites b4 going live ?
Hi Ive instructed clients to password protect dev areas so dont get crawled and indexed but how do we set up Moz crawl software so we can crawl theses sites for final check of any issues before going live ? Is there an option i havnt seen to add logins/passwords for crawl software to access ? cheers dan
Moz Bar | | Dan-Lawrence0 -
Where to find one off crawl report
Hello, I don't know if I am being a bit daft but I don't seem to be able to find the area where I can request a one off crawl report anymore (rather than setting up a campaign). Can someone let me know where this is now? Thanks!
Moz Bar | | RikkiD220 -
Is there a problem with New Campaign crawls being slow?
Hi I've created 3 new campaigns but results not showing as usual. I know the full results take up to 7 days but I usually see some basic info in a few minutes of creating the campaign. This problem happened a while ago and the campaign was never quite right in SEOMoz. Thanks for your help Steve
Moz Bar | | stevecounsell0
