Is SeoMOZ Crawl Diagnostics wrong here?
-
We've been getting a ton of critical errors (about 80,000) in SeoMoz' Crawl Diagnostics saying we have duplicate content in our client's E-commerce site. Some of the errors are correct, but a lot of the pages are variations like:
www.example.com/productlist?page=1
www.example.com/productlist?page=2
However, in our source code we have used rel="prev" and rel="next" so in my opinion we should be alright.
Would love to hear from you if we have made a mistake or if it is an error in SeoMoz.
Here's a full paste of the script:
-
Just a minor clarification - you can use both rel=prev/next and rel=canonical, IF you have something like search filters. Then, the canonical would point to the unfiltered current page and the rel=prev/next would point to the filtered paginated pages. Yeah, I know, that made a lot of sense. Let's say your page is:
http://example.com/stuff?page=2&sort=price
...then you might have
It's more than a little confusing.
Definitely check out that JavaScript issue, though - it might be that bots aren't seeing what people are seeing, and that could be very dangerous.
-
Hi,
In regards the rel=next you are absolutely right, I must have overlooked it or just searched for the prev tag. So yes as far as proper implementation of the prev/next in that respect it is correct and please ignore that last part of my first post!
Turning of javascript is instructive to see all those tags on their individual page and helps clarify what exactly is being outputted and when without the dynamic loading, providing you don't miss a rel=next tag that is really there
-
Hi Lynn,
Thank you very much for your answer / analysis! As you said "It is a bit confusing" and I will just read your answer a couple of times...
I will grant your answer "Good answer" for you thorough analysis! I think it is spot on with the double "next/prev" and "rel=can" tags. I do have one remark. You said: When I turn off javescript, I get this:
In my opinion this is alright, because it shouldn't have a "prev" as this is the initial page.
-
Hi,
I had a look at what I assume is the site and I think you have a combination of things going on that is likely causing confusion (to you, to the moz bot, probably to google too!)
Firstly, it is not recommended to use rel prev/next and rel canonical on the same page. With that what you are effectively doing is only indexing the first page of the results since all the other pages rel canonical back to the first one. If you have a 'view all' type page then you could rel canonical all of the paginated pages back to this one and you would not need to use the prev/next tags at all. It is also possible that your use of relative canonical links in combination with the above is also causing confusion, usually best to use absolute urls if possible.
Beyond that, the site dynamically loads more products as you scroll down the page which also results in the url changing to hoeretelefon/? for ALL the pages. If that is a problem or not depends on how it is coded and how the google and seomoz bots are deciding to parse the page, but it certainly adds another potential area of complexity to the issue.
Lastly, if you browse the site with javascript turned off you can see something odd in that the initial page /elektronik/baerbar-lyd/hoeretelefon has no prev/next OR canonical tag but has a link to /elektronik/baerbar-lyd/hoeretelefon?page=1 on which you find prev/next and canonicals back to the non paginated version. So you are basically skipping the pagination setup that goes from the original to the page=1 (but also giving a canonical back to the original page).
Phew! It is a bit confusing. I would recommend deciding on if you want to go with prev/next or canonical in the first place and take it from there. I would think that if you have the ability to canonical to a 'see all products page' then this might be the best way to go since it should theoretically take care of any issues the dynamic loading is causing also.
Hope that helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawl Errors and Notices drop to zero
Hi all, After setting up a campaign in Moz the crawl is successful and it showed the Errors and Warnings in crawl diagnostics (each one had about 40-50), but after a few days the number dropped to zero. Only the "notices" seems to stay normal, with a slight drop since the campaign set up, but not dropping to zero. I set this campaign up in a colleague's account and the same thing happened shortly after set up. I didn't find any Q&A already posted so any insight is appreciated!
Moz Pro | | Vanessa120 -
Sharing/Transferring SEOMOZ campaigns
What happens when you are no longer working on a campaign, and your client needs the campaign history? I don't pay for my account, my employer does. If I ever have to move on what should I do with the account? I would want to keep my seomoz profile and Q&A history. But the campaigns belong to my employer so I would have to change all of the profile settings into his name… Is there a protocol for this kind of situation?
Moz Pro | | BeTheBoss0 -
help with the inbound links side of seomoz
Hi Can somebody help with the inbound links tool of seomoz, can you point me in the direction of how it works and the best practices to get the most from it. I know i have a lot more inbound links to the site in my campaign but its shows for example 114 links but when i click on show more it only shows 3 . am i doing something wrong? Any help and advice from how people use it , what for and what is best practice thanks.
Moz Pro | | Bristolweb0 -
Issue in number of pages crawled
i wanted to figure out how our friend Roger Bot works. On the first crawl of one of my large sites, the number of pages crawled stopped at 10000 (due to the restriction on the pro account). However after a few weeks, the number of pages crawled went down to about 5500. This number seemed to be a more accurate count of the pages on our site. Today, it seems that Roger Bot has completed another crawl and the number is up to 10000 again. I know there has been no downtime on our site, and the items that we fixed on our site did not reduce or increase the number of pages we had. Just making sure there are no known issues with Roger Bot before I look deeper into our site to see if there is an issue. Thanks!
Moz Pro | | cchhita0 -
SEomoz slow to crawl?
Hello - I am just trying out the trial and it said the next crawl was nov 1st but I see no change in any of the errors since the initial crawl... so just waiting to find out if what I changed was fixed or not. Is this normal ?
Moz Pro | | Bethany_BabyBrowns0 -
Campaign Not Crawling
I set up my first 5 campaigns and one is not crawling beyond one-page. It's been over 48 hours. This site has nearly 3.500 pages the others much less, however, this shouldn't make any difference. I searched for the problem and couldn't find it so I hope this question isn't redundant. Comments and advice would be appreciated.
Moz Pro | | JavaManOne0 -
SEOMoz Pro and Multiple Niche Sites
Currently I have 15 affiliate marketing sites and three blogs which are monetized. My budget dictates the base pro package so may I get some recommendations on how or if I can do analysis over time for all the sites. I ask this because it seems you would set your campaigns for long-term but I imagine you delete/modify/add campaigns to analyze different key words. Thanks for your help.
Moz Pro | | JavaManOne0