Is Moz Bot Broken?
-
Moz Bot says I have millions of issues with duplicate content.
One item says that it has over 50 duplicates! I downloaded the CSV it gave me to look into it.
All of my products have many different ways to get them, so I've set up rel=canonicals for the master one. So, I'd assume Mozbot would ignore those.
But the interesting thing I've found is that of these 50 duplicates, some of them (on the same CSV I downloaded) are completely different products, with completely different URL's. and completely different titles and completely different meta descriptions and completely different product descriptions.
So, 3 questions:
-
Is Moz bot broken?
-
Does it not recognize canonicals?
-
Why is it seeing 3 very different products as exactly the same product?
I'm so confused and since I work for a national company, the only way I can give actual examples is through a private message session. I guess I'm wondering if anyone else has come across this issue? Because I'm completely baffled.
-
-
Hello David,
Thanks for the response. I was able to receive a response in Chat yesterday that was very similar. All of the different URL's for the same product were pointing to the same canonical (the right one), so I was highly confused. Knowing that it's about Source Code helps a lot. Giant ecommerce sites like the one I'm working for it seems would have this issue more than smaller, boutique sites.
All of the products have their own unique product descriptions and titles & meta descriptions. So, for our brand, it is about the source code. I can suggest that the writers add more copy to their descriptions, but I can't imagine that will be a fun conversation.
I really appreciate the thoughtful answer to my question. Thanks so much!
-
Hello!
Our campaigns have 90% tolerance for duplicate content so this means if the page source code is at least 90% similar, it will be flagged.
Canonicals will only work if all pages that are truly identical each point to the same canonical URL
So if you have something like www.domain.com/productA/ as the primary URL for a single product
All 3 URLs below need to point to "www.domain.com/productA/" as the canonical
www.domain.com/productA/color=blue
www.domain.com/productA/category/tag
www.domain.com/productA/page1For another product www.domain/productB/
These will always report as a duplicate of productA if there isn't enough unique content to prevent them from being too similar due to the layout/template making up the majority of the source code.
For pages that are completely targeting separate products, those cannot be ignored so it will help to add more unique content to those pages to prevent getting flagged.
Here is a great article on how you can address duplicates for a site like yours: www.goinflow.com/duplicate-content-ecommerce-seo/
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I have recently switzed to SSL on ramxpert.dk, now Moz is not able to crawl the site anymore
Hi Moz I have recently switzed to SSL on ramxpert.dk, now Moz is not able to crawl anymore. When I look at the crawl report there is just one fault displayed: "403 : Received 403 (Forbidden) error response for page." How can i solve this issue asap? I was not aware that there would be any issues with moz when activating a SSL certificate on the site. The campaign with the problem is: ramxpert.dk. Regards
Moz Bar | | WebBoost
Jesper Nielsen0 -
Is Moz going to provide mobile ranking tools?
With the mobilegeddon update quickly approaching us on April 21, I wanted to know if Moz is going to provide any insight into mobile rankings vs. desktop rankings? Are there any other tools we can use to benchmark and gain insight into this kind of data?
Moz Bar | | jgrammer2 -
Moz Crawl Test Trying to Crawl Contact Form Submit Button Location?
Moz Crawl Test for some reason is trying to Crawl a contact form Widget Submit Location. My obvious guess is that obviously the crawl cannot submit to the required fields…..I believe this because they're only kicking back these errors on the pages I have a contact form widget on. http://crawfordspest.com/pest-control/crawfords@crawfordspest.com 1412553693 404 : Received 404 (Not Found) error response for page. Error attempting to request page; see title for details. 404
Moz Bar | | Funk-Creative-Media
http://crawfordspest.com/tree-services/crawfords@crawfordspest.com 1412553693 404 : Received 404 (Not Found) error response for page. Error attempting to request page; see title for details. 404
http://crawfordspest.com/lawn-care/crawfords@crawfordspest.com 1412553693 404 : Received 404 (Not Found) error response for page. Error attempting to request page; see title for details. 404
http://crawfordspest.com/specialty-services/crawfords@crawfordspest.com 1412553693 404 : Received 404 (Not Found) error response for page. Error attempting to request page; see title for details. 404 Can you shed any insight to this? I'm a bit worried that I'll have to complete gut the contact form which was one of the major requests my client requested. Or in a worse scenario make all fields not required. It would let so much spam in. I have never seem anything like this at all. But I've learned a lot from Moz, and with major errors like 404 damage Domain Authority greatly. I've fixed 404 issues with newly acquired clients existing sites and tracked through Moz and the domain authority flies up once these errors are fixed. Along with fixing what Webmaster Tools through Google reports back. ..... Let me know if you have any expertise on this matter.0 -
403 Error on WMT but not on MOZ?
Hello, 2 days ago I found there are about 1200 of 403 errors by Google WMT when I tried to fetch my domain - Please see attached HTTP/1.1 403 Access Forbidden Cache-Control: private Content-Type: text/html ETag: "" Server: Set-Cookie: ASPSESSIONIDSSBARTSD=BEHMJHJBKJOEJEALECNNIPFH; path=/; HttpOnly X-Powered-By: Date: Tue, 18 Feb 2014 13:54:10 GMT Content-Length: 1233 <title>403 - Forbidden: Access is denied.</title> Server Error <fieldset> 403 - Forbidden: Access is denied. You do not have permission to view this directory or page using the credentials that you supplied. </fieldset> I ran a complete report using MOZ but I was shocked not see any 4xx , 5xx errors. Google: 246 of 404 errors No Google, Yahoo or Bing blocking HTTP status code: ALL 200 301 redirect: none? I have done about 2500 over 4 years. The website is losing indexed pages. I'm not sure what's going and which numbers to trust. Please help. Thank you. Adam
Moz Bar | | homs830 -
How can I find the old ERRORS and WARNINGS report in the NEW Moz design?
I'm looking for a complete list of errors and bugs that need to be fixed within a website. I used to use the MAIN tool (at least it seemed it was the most popular) but now that its just MOZ.com I can't seem to find that great report. It had data such as: 1. List of pages with Title Tags too long 2. List of pages with Description Tags too long 3. List of RED errors and YELLOW warnings, BLUE somethings... etc... Ring a bell? I LOVED this report, where can I find this data? Thanks! Derek
Moz Bar | | DerekM42420 -
Confusing Moz Crawl?
Hi there, I am not sure if I am missing on something but the moz crawls are rather confusing. After singing in I have received 11 emails with crawls and today I have received again new, When I go to check there to the dashboard it shows 26 pages with issues. When I scroll down I see the pages with issue. Then when I click on the first page listed, to view the issues it says this: Rel Canonical
Moz Bar | | Rebeca1
Using rel=canonical suggests to search engines which URL should be seen as canonical. For this site: http://villasdiani.com/ but we have sorted out the canonical issues a long time ago. Is this a wrong information or is it really true that we do not specify the canonical for our site? Then the second page with issue is there listed http://villasdiani.com/beach-villas/ and it says: Duplicate Page Title
You should use unique titles for your different pages to ensure that they describe each page uniquely and don't compete with each other for keyword relevance. But it does not point out which page is duplicate with this one! I do not have any other page named the same way. It also says in Issues overview 26pages with issues, but it shows on the bottom only 5 under and when I click on view more it brings me to high priority issues where is 0. The most is freaking me out this report: When I click on links, there are listed on the bottom the pages with highest authority among which I found this http://villasdiani.com/db I have never created this kind of page! Funny enough when I click on it it really open that page! How this can be??? In issues overview it also shows on the bottom, right corner 11 page with duplicate content but when I click on it to review it it brings me to high priority issues windows where is not displayed anything Can somebody advice me regarding of this. I have sign up here to learn and sort out the problems with the site but so far I am only getting more confused here. Thank you very much for looking into this.0 -
Pro.moz.com referrals and transactions
Our Google Analytics account reports a significant number of visits and transactions as referrals from pro.moz.com. That is nice and we appreciate this but where is the traffic generated from ? (my first MOZ question)
Moz Bar | | silverpewter0 -
Rel Canonical and Moz Crawl
we have Rel Canonical tags set up on a few pages. When viewing the page source, the tags are correct. However, Moz Crawl results show the opposite. for example the page source, correctly shows, URL X with a Rel canonical Tag of URL Y
Moz Bar | | S.S.N
but.. Moz crawl is showing URL Y with a Rel Canonical Tag of URL X ..any thoughts why this would happen? which should i trust more?0