Is Moz Bot Broken?
-
Moz Bot says I have millions of issues with duplicate content.
One item says that it has over 50 duplicates! I downloaded the CSV it gave me to look into it.
All of my products have many different ways to get them, so I've set up rel=canonicals for the master one. So, I'd assume Mozbot would ignore those.
But the interesting thing I've found is that of these 50 duplicates, some of them (on the same CSV I downloaded) are completely different products, with completely different URL's. and completely different titles and completely different meta descriptions and completely different product descriptions.
So, 3 questions:
-
Is Moz bot broken?
-
Does it not recognize canonicals?
-
Why is it seeing 3 very different products as exactly the same product?
I'm so confused and since I work for a national company, the only way I can give actual examples is through a private message session. I guess I'm wondering if anyone else has come across this issue? Because I'm completely baffled.
-
-
Hello David,
Thanks for the response. I was able to receive a response in Chat yesterday that was very similar. All of the different URL's for the same product were pointing to the same canonical (the right one), so I was highly confused. Knowing that it's about Source Code helps a lot. Giant ecommerce sites like the one I'm working for it seems would have this issue more than smaller, boutique sites.
All of the products have their own unique product descriptions and titles & meta descriptions. So, for our brand, it is about the source code. I can suggest that the writers add more copy to their descriptions, but I can't imagine that will be a fun conversation.
I really appreciate the thoughtful answer to my question. Thanks so much!
-
Hello!
Our campaigns have 90% tolerance for duplicate content so this means if the page source code is at least 90% similar, it will be flagged.
Canonicals will only work if all pages that are truly identical each point to the same canonical URL
So if you have something like www.domain.com/productA/ as the primary URL for a single product
All 3 URLs below need to point to "www.domain.com/productA/" as the canonical
www.domain.com/productA/color=blue
www.domain.com/productA/category/tag
www.domain.com/productA/page1For another product www.domain/productB/
These will always report as a duplicate of productA if there isn't enough unique content to prevent them from being too similar due to the layout/template making up the majority of the source code.
For pages that are completely targeting separate products, those cannot be ignored so it will help to add more unique content to those pages to prevent getting flagged.
Here is a great article on how you can address duplicates for a site like yours: www.goinflow.com/duplicate-content-ecommerce-seo/
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Crawler fails on the first page
Hi guys, Can anybody shed some light, I'm running a crawl on a client's website but it's failing on the homepage and not crawling any other pages. It appears to be throwing an 804: HTTPS (SSL) error and then terminating the crawl. Now, the page in question was serving up mixed content up until about 4 days ago, but has since been fixed. I read that we should wait at least 48 hours before initiating another crawl to avoid hitting a cached version - which I did, but it still appears to be having issues. Is there anything specific I can do to get around this issue? I'm on a trial account and this feature is one I'm keen to test, so there is a bit of a time constraint. Any help is greatly appreciated! Thanks in advance!
Moz Bar | | philipdanielhayton0 -
Moz On-Page Grader doesn't pick up my Title, URL, Meta, H1, Body, IMG ALT's....does this mean Google won't?
Good morning, As my title says, 'Moz On-Page Grader doesn't pick up my Title, URL, Meta, H1, Body, IMG ALT's....does this mean Google won't?' My URL is www.refusedcarfinance.com and I'm currently targeting the Keyword 'bad credit car finance'. I am using Yoast SEO and have the keyword in my title, meta, content, h1's etc. Any advice would my much appreciated. Kindest regards, Joshua
Moz Bar | | RocketStats0 -
I update content and then craw but the MOZ spider still shows old content. Do I need to update something else?
"This shows but was replaced a day before I ran Moz crawer: | We provide a full service for low cost automated phone calls, robocalls, Bulk SMS service, Political robo calls without needing computer skills | "
Moz Bar | | ThomasDaBomb
I look in the link on website and see:
<title>Our customers talk about: Currently the tremendous growth of organi</title> Why does the craw not reflect the current content? Thanks.
Thomas0 -
Moz crawler finding my homepage multiple times
Hi and thank you in advance for your help! I have a Moz Pro campaign running (I am a complete Moz novice by the way) for one of my websites (balloonsutah.com). After crawling my site, the Moz crawler informed me that I have 3 pages with duplicate content. While I am not sure why exactly this is happening, the crawler indexed my homepage 3 times under different url's. -balloonsutah.com
Moz Bar | | Keenan-Price
-balloonsutah.com/
-balloonsutah.com/index.html I checked my FTP server and I cannot figure out for the life of me why the crawler is finding anything other than the index.html file. I suppose I need to do something regarding a rel="Canonical" but I am not terribly familiar with that either. Any suggestions would be greatly appreciated!
Keenan0 -
How old is this Moz quiz?
Does anyone know? I want to use it as a study tool if the info is still current. SEO Expert Quiz
Moz Bar | | SSFCU
http://moz.com/seo-expert-quiz Thanks,
Sarah0 -
Moz Local | Empty page "Categories"
Dear Moz, Another error, the following url loads an empty page https://moz.com/local/categories Please review Thanks!
Moz Bar | | Bio-RadAbs0 -
Does moz Ranking report canadian rankings?
Hi I would like to know Moz rankings can report canadian ranking or does it just focuses on US market search engines only? If it does also focuses on the canadian market, how do you set it up? Thanks
Moz Bar | | Ideas-Money-Art0 -
Rel Canonical and Moz Crawl
we have Rel Canonical tags set up on a few pages. When viewing the page source, the tags are correct. However, Moz Crawl results show the opposite. for example the page source, correctly shows, URL X with a Rel canonical Tag of URL Y
Moz Bar | | S.S.N
but.. Moz crawl is showing URL Y with a Rel Canonical Tag of URL X ..any thoughts why this would happen? which should i trust more?0