Is Moz Bot Broken?
-
Moz Bot says I have millions of issues with duplicate content.
One item says that it has over 50 duplicates! I downloaded the CSV it gave me to look into it.
All of my products have many different ways to get them, so I've set up rel=canonicals for the master one. So, I'd assume Mozbot would ignore those.
But the interesting thing I've found is that of these 50 duplicates, some of them (on the same CSV I downloaded) are completely different products, with completely different URL's. and completely different titles and completely different meta descriptions and completely different product descriptions.
So, 3 questions:
-
Is Moz bot broken?
-
Does it not recognize canonicals?
-
Why is it seeing 3 very different products as exactly the same product?
I'm so confused and since I work for a national company, the only way I can give actual examples is through a private message session. I guess I'm wondering if anyone else has come across this issue? Because I'm completely baffled.
-
-
Hello David,
Thanks for the response. I was able to receive a response in Chat yesterday that was very similar. All of the different URL's for the same product were pointing to the same canonical (the right one), so I was highly confused. Knowing that it's about Source Code helps a lot. Giant ecommerce sites like the one I'm working for it seems would have this issue more than smaller, boutique sites.
All of the products have their own unique product descriptions and titles & meta descriptions. So, for our brand, it is about the source code. I can suggest that the writers add more copy to their descriptions, but I can't imagine that will be a fun conversation.
I really appreciate the thoughtful answer to my question. Thanks so much!
-
Hello!
Our campaigns have 90% tolerance for duplicate content so this means if the page source code is at least 90% similar, it will be flagged.
Canonicals will only work if all pages that are truly identical each point to the same canonical URL
So if you have something like www.domain.com/productA/ as the primary URL for a single product
All 3 URLs below need to point to "www.domain.com/productA/" as the canonical
www.domain.com/productA/color=blue
www.domain.com/productA/category/tag
www.domain.com/productA/page1For another product www.domain/productB/
These will always report as a duplicate of productA if there isn't enough unique content to prevent them from being too similar due to the layout/template making up the majority of the source code.
For pages that are completely targeting separate products, those cannot be ignored so it will help to add more unique content to those pages to prevent getting flagged.
Here is a great article on how you can address duplicates for a site like yours: www.goinflow.com/duplicate-content-ecommerce-seo/
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why do my Moz duplicate content results show me pages with no noticeably similar content?
Sometimes the "Pages with Duplicate Content" results under Content Issues show pages that, from what I'm able to see or otherwise test, have no duplicate content, save for the same navigation that exists on all of my pages. For example, a recent issue said that the following pages had duplicate content:
Moz Bar | | rickmic
https://freezerworks.com/index.php/html/slider-overlay
https://freezerworks.com/index.php/ufaqs/what-do-i-get-with-my-purchase-of-freezerworks
https://freezerworks.com/index.php/videos/fda-and-freezerworks-2
https://freezerworks.com/index.php/lims-testing-module Even a side-by-side of the page source in a text comparison tool shows nothing but navigation and scripts used in every page. Am I not seeing something?2 -
Increase Moz authority above 26
Hi, I have been using Moz for 12 months and found some very useful features. My site’s score steadily increased from 18 to 26. But I seem to have now ‘hit a wall’ and my Moz ranking is static. My question is: Where on Moz.com can I find what next steps I need to take to improve my Moz score? Thanks in advance. Matt
Moz Bar | | wonderdome0 -
Idea for new feature on Moz Q&A
Hi Moz Can we please have a new feature to moz when answering questions please, the ability to save as a draft. I am currently on the train from London back home and I was trying to answer a few questions and give my opinion and after writing a really long and detailed response to an area I actually have quite a lot to say on, my internet froze and the page refreshed losing all the content. It doesn’t help that my Mac I am working on isn’t the fastest, but my new one isn’t quite ready yet. But if there was a simple save draft feature, it would be really great as I wasn’t ready to post my answer as it wasn’t finished and without checking wouldn’t have made sense. Yes I know I could of done it in word and pasted it across, but usually when I am travelling and answering questions I do it on my Ipad which isn’t great for multitasking. While I understand you don’t want lots of ‘draft answers’ all over the place as this would take storage space up on your servers and doesn’t actually help the person answering the question, your system could purge all draft answers which have not been edited in the last 24 hours. Just a little suggestion to help make this great forum even better. Thanks Andy
Moz Bar | | Andy-Halliday4 -
Why do my search results differ from MOZ's rank tracker
This is starting to happen a lot, i mean they weren't always an exact match but they differed by a few places. But now the gap between results I'm getting and MOZ's own rank tracker is quite large. For my keyword my page ranks on MOZ at 39 (it was 25 but has slipped down). Im seeing my page on page 1 locally and page 2 in incognito mode. Now I understand there are other factors such as browser history, cookies, am i logged into gmail etc. Thats why I asked colleagues to use Internet explorer and they have nothing to do with SEO so their history wont affect the search. They report seeing it on page 2, even colleagues in a different office in a different city sees it on page 2. I want to contact the department in question and share the good news that they've gone from none existent to 14th in what is a very competitive area. But MOZ's result has be second guessing whether I should. Any ideas why the gap between results is so large? Thanks
Moz Bar | | Brabian0 -
Why does it show (in Moz) that we don't have any meta descriptions on our site when we do?
We have over 1,330 pages that say we are "Missing Meta Description Tag" when I spot check all of them have meta descriptions? Can you please explain to me why Moz is picking up that we do not have meta descriptions when we do. Our website http://www.betheboss.ca Please help. I would like a accurate measure of meta descriptions that are missing.
Moz Bar | | BeTheBoss0 -
Moz toolbar Broken ?
Hi everybody, It seems the Moz toolbar isn't working properly for two days (Amsterdam Time zone GWMT +1) - we are located in the Netherlands. My colleague and me are have the same experience. Nothing is displayed anymore (no PA, mR, DA or Links) the sections with the pencil (follow and no follow) is working. Working in firefox 26.0.Does anybody has the same issue? Moz is this a global / local problem?
Moz Bar | | lveembergen0 -
Moz Toolbar Make My Browser Slower Drastically!
Hi, I really like Moz toolbar but it's totally make my browser (Firefox 26) slower (open new tab, new site, close / open the browser, etc.) What can I do to make it works faster With Moz toolbar? Thanks
Moz Bar | | JonsonSwartz0 -
Blocked Production Site from Search Engines - How to get it Crawled by Moz Crawler
I have an 'under development' site hosted, (which is an exact replica of live site as working on to add new functionalities & modules) - but its password protected, excluded from robots.txt (Disallow) & also marked noindex on all pages in the index - so that Googlebot & other Search Engines can not crawl the site At present the development work is almost 95% completed., Now - feel like to crawl the site through SEOMOZ Roger Bot - to know the errors and all indexed urls by Rogerbot. What's the best way to get Moz Bot crawl the site - but simultaneously continue it blocking its access to Search Engines I have gone through - https://support.google.com/webmasters/answer/93708?hl=en, it says a) Save it in a password-protected directory. Googlebot and other spiders won't be able to access the content- But this way Moz will also not be able to crawl the site b) Use a robots.txt to control access to files and directories on your server - However it also says - It's important to note that even if you use a robots.txt file to block spiders from crawling content on your site, Google could discover it in other ways and add it to our index. c) Use a noindex meta tag to prevent content from appearing in our search results - It also says that a link to the page can still appear in their search results. Because we have to crawl your page in order to see the noindex tag, there's a small chance that Googlebot won't see and respect the noindex meta tag Password Protected thus seems the best way to continue blocking. However, continuing with it will also block Moz bot to crawl the site. Any suggestions Thanks
Moz Bar | | Modi0