Is SeoMOZ Crawl Diagnostics wrong here?
-
We've been getting a ton of critical errors (about 80,000) in SeoMoz' Crawl Diagnostics saying we have duplicate content in our client's E-commerce site. Some of the errors are correct, but a lot of the pages are variations like:
www.example.com/productlist?page=1
www.example.com/productlist?page=2
However, in our source code we have used rel="prev" and rel="next" so in my opinion we should be alright.
Would love to hear from you if we have made a mistake or if it is an error in SeoMoz.
Here's a full paste of the script:
-
Just a minor clarification - you can use both rel=prev/next and rel=canonical, IF you have something like search filters. Then, the canonical would point to the unfiltered current page and the rel=prev/next would point to the filtered paginated pages. Yeah, I know, that made a lot of sense. Let's say your page is:
http://example.com/stuff?page=2&sort=price
...then you might have
It's more than a little confusing.
Definitely check out that JavaScript issue, though - it might be that bots aren't seeing what people are seeing, and that could be very dangerous.
-
Hi,
In regards the rel=next you are absolutely right, I must have overlooked it or just searched for the prev tag. So yes as far as proper implementation of the prev/next in that respect it is correct and please ignore that last part of my first post!
Turning of javascript is instructive to see all those tags on their individual page and helps clarify what exactly is being outputted and when without the dynamic loading, providing you don't miss a rel=next tag that is really there
-
Hi Lynn,
Thank you very much for your answer / analysis! As you said "It is a bit confusing" and I will just read your answer a couple of times...
I will grant your answer "Good answer" for you thorough analysis! I think it is spot on with the double "next/prev" and "rel=can" tags. I do have one remark. You said: When I turn off javescript, I get this:
In my opinion this is alright, because it shouldn't have a "prev" as this is the initial page.
-
Hi,
I had a look at what I assume is the site and I think you have a combination of things going on that is likely causing confusion (to you, to the moz bot, probably to google too!)
Firstly, it is not recommended to use rel prev/next and rel canonical on the same page. With that what you are effectively doing is only indexing the first page of the results since all the other pages rel canonical back to the first one. If you have a 'view all' type page then you could rel canonical all of the paginated pages back to this one and you would not need to use the prev/next tags at all. It is also possible that your use of relative canonical links in combination with the above is also causing confusion, usually best to use absolute urls if possible.
Beyond that, the site dynamically loads more products as you scroll down the page which also results in the url changing to hoeretelefon/? for ALL the pages. If that is a problem or not depends on how it is coded and how the google and seomoz bots are deciding to parse the page, but it certainly adds another potential area of complexity to the issue.
Lastly, if you browse the site with javascript turned off you can see something odd in that the initial page /elektronik/baerbar-lyd/hoeretelefon has no prev/next OR canonical tag but has a link to /elektronik/baerbar-lyd/hoeretelefon?page=1 on which you find prev/next and canonicals back to the non paginated version. So you are basically skipping the pagination setup that goes from the original to the page=1 (but also giving a canonical back to the original page).
Phew! It is a bit confusing. I would recommend deciding on if you want to go with prev/next or canonical in the first place and take it from there. I would think that if you have the ability to canonical to a 'see all products page' then this might be the best way to go since it should theoretically take care of any issues the dynamic loading is causing also.
Hope that helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Difference between SEOmoz Pro and Mozscape API
Hi, I probably put this question in a wrong category, so I'd like to ask again. I am new in SEOmoz and writing this from Japan.
Moz Pro | | flaminGoGo
I have couple of questions and really appriciate if you can help me to understand SEOmoz. better. First of all, what is the difference between SEOmoz Pro and Mozscape API? I signed up for 30days free trial and now continue being $99 PROmember.
Is that correct that rate limit is one request every 2 seconds with PRO? and also want to know about free API that I found after signed up for PRO.
Is there any restrictions on free API except for rate limit is one request every 10 seconds? The main reason I signed up for SEOmoz was to use the API link metrics, and because of the language I got really confused now.0 -
SEOMoz Question
Hi, I have taken over SEO on a real estate site with an internal blog. Unfortunately there are loads of duplicated pages and titles in the blog. It was suggested that all should be rel=canonical so not to show up. In my last crawl here though they still do. So question is if SEOMoz crawls and sees them is Google also seeing them? Also would it be best to move the blog off site so this does not cause anymore damage and just link to it from the main site? Thanks for your comments
Moz Pro | | AkilarOffice0 -
How can I cancel a running crawl test?
I put in two urls that were incorrect and now I need to cancel the report generation. Is there a way to do this? And if so, would I get my crawl-credits back? Are they cumulative?
Moz Pro | | krenerr0 -
Video SERP and Seomoz ranking
It seems that my keywords that lead to videoresults in SERP, is not being ranked on Seomoz! How come when i rank #3 on a certain keyword with a videoresult Seomoz is displaying me as #15 (which is the second of my pages in SERP)? What is the reason for not counting the video-result in the ranking-tool?
Moz Pro | | alsvik0 -
SEOmoz Report: Competitive Domain Analysis
Hi there, According to SEOmoz Dashboard's Competitive Domain Analysis, the 'Total Links' for our domain shot up (more than quatripled) in the last few weeks. We haven't really done much link building in over 6 months so not sure how to explain this. Did SEOmoz make updates to their bots? Could it be that the bots are finding all these links only now? We've been using SEOmoz reporting for almost a year now, and I've never seen this before. Some insight / explanation for this would be great. Thanks in advance,
Moz Pro | | RBA
Gemma0 -
SEOmoz crawler bug?
I just noticed that a few of my campaigns have number of pages crawled 1. Can someone tell me what this is.... from 5 campaigns 2 have only one pages crawled from which one is an online shop with over 2000 products 🙂
Moz Pro | | mosaicpro0 -
Discrepancies in link reports from SEOMoz and OSE
Hello, I am trying to understand the link profile of my site. In the competitive analysis from SEOMoz, it shows 22K+ of links, with about 900+ being external followed links and 800+ internal. Webmaster tools shows a similar number of external followed links, but the link report from OSE only shows about 150 external followed links. This brings up several questions: Where is this 22K total links coming from? Why is there such a difference in the SEOMoz competitive analysis and the OSE report? Why does the OSE report show some links as not followed, while Webmaster tools lists them as followed? Am new to the off-page aspects of SEO, and I have to say the discrepancy in data from different tools is by far the most challenging thing for me. Would welcome general advice on this topic as well. Thank you!
Moz Pro | | LynnMarie0