Site Crawl - MOz Pro
-
Hi There,
When i look into my site crawl i have thousands of duplicate content issues. Now they are essentially product pages which are in multiple categories - however we have added the canonical tag so im confused as to why all of these are appearing as if there is an error, does the MOZ bot not take canonicals into account?
Kind Regards
Gemma
-
Hi there! We do take canonicals into account. Our tool has a 90% tolerance for duplicate content, which means it will flag any content that has 90% of the same code between pages. This includes all the source code on the page and not just the viewable text. If you're seeing duplicate content flagged, it's likely due to issues with how the canonical tags are set up.
For more info on canonicalization best practices, check out this article: https://moz.com/learn/seo/canonicalization
If you're still unsure why your pages are being flagged, feel free to reach out to us at help@moz.com!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Links between my two sites
I have a branded site (corporate site) that has links to my blog site. I am trying to locate all the links between the two. Most importantly from the BRANDED site to my BLOG. I've tried the inbound link but it shows I have none. What or how am I searching wrong?
Moz Bar | | Bwaples0 -
Does Moz have a way to export full SERPs yet?
I don't like being restricted to tracking only three competitors' rankings so I'm wondering if I could just export the full SERPs like I can on Ahrefs and SEMrush.
Moz Bar | | QLP20040 -
Crawl report shows that it gets 4xx errors for pages that work fine. Why?
On the crawl report it has all these "Critical Crawler Issues". They all say "4xx Error", yet when i click on the link from the crawler report, it goes to a perfectly functioning page, not a 404 page or anything. If i click in it actually says it's a 403 error. It's all for pages generated by the IDX solution for our real estate website. Is Moz broken or am i missing something? Here are a couple examples: <dl class="crawl-page-details-list"> <dd class="crawl-page-details-list-emphasis">https://teamvivi.com/homes-for-sale-map-search/</dd> <dd class="crawl-page-details-list-emphasis"> <dl class="crawl-page-details-list"> <dd class="crawl-page-details-list-emphasis">https://teamvivi.com/email-alerts/</dd> </dl> </dd> </dl>
Moz Bar | | TeamViviRealEstate0 -
Cannot Crawl ... 612 : Page banned by error response for robots.txt.
I tried to crawl www.cartronix.com and I get this error: 612 : Page banned by error response for robots.txt. I have a robots.txt file and it does not appear to be blocking anything www.cartronix.com/robots.txt Also, Search Console is showing "allowed" in the robots.txt test... I've crawled many of our other sites that are similarly set up without issue. What could the problem be?
Moz Bar | | 1sixty80 -
All in favor of an "Announcements" category section say MOZ!
So this is just a thought. I am not Rand, therefor I am not the Moz man himself, and therefor I am not telling anybody how to run this website or forum. But, I've been thinking... and usually that a dangerous thing. So many times when I answer a question I end it with: "Keep me posted" "Keep us updated" "Good Luck" In the same light there have been plenty of times when I have had my questions answered by people like EGOL, RobertFIsher, KeriMorget and they have said that they have wanted me to keep them posted. Now sure, some of you are sitting there being Melancholy Mozzers thinking that all those wonderful people are just being polite by adding some nice parting words... but what if I they are being Sincere Seoers? What if I WANT to fill them in and don't want to ask a question? What if... THEY REALLY LIKE ME?!?! I could also send a DM to those 3 people, I mean let's get honest I'm not THAT popular.... but I can dream can't I? Again, this isn't really an SEO question, more of a thought on where I'm supposed to give updates on my project. In all honesty I do want feedback on what I'm doing, and sometimes I don't even know what questions I'm supposed to ask!
Moz Bar | | HashtagHustler1 -
Moz Local Time Frame
I must have missed it. How long does it take Moz Local to do its thing once the service has been paid?
Moz Bar | | RelativeHealing0 -
Reports on MOZ
Hello there, I am still pretty inexpert in using Moz and I was wondering if there is a way to retrieve reports from previous weeks. Many thanks Oscar
Moz Bar | | PremioOscar0 -
I already have a campaign registered in moz, but it does not appear when I open Moz Analytics, as I proceed?
I received an email suggesting you upgrade to Moz Analytics, however to do the procedure my existing campaign stopped appearing and I can not access it, how should I proceed?I need back to Pro?
Moz Bar | | IBacana0