Tired of finding solution for duplicate contents.

[chandubaba]

Just my site was scanned by seomoz and seen lots of duplicate content and titles found. Well I am tired of finding solutions of duplicate content for a shopping site product category page. You can see the screenshot below.

http://i.imgur.com/TXPretv.png

You can see below in every link its showing "items_per_page=64, 128 etc.". This happened in every category in which I was created. I am already using Canonical add-on to avoid this problem but still it's there.

You can check my domain here - http://www.plugnbuy.com/computer-software/pc-security/antivirus-internet-security/ and see if the add-on working correct.

I recently submitted my sitemap to GWT, so that's why it's not showing me any report regarding duplicate issues.

Please help ME

[chandubaba]

Thank you. I will tell to my developer regarding this issue and than see what they reply.

[Dr-Pete]

You could canonical the "/portable-hard-disk" pages back up to "/hard-disk", but honestly, unless this is a widespread problem, I'd probably ignore it. if you have a lot of these sub-categories with duplicate search results, then I'd consider changing up your canonical scheme or NOINDEX'ing some sub-categories - search results just aren't high-value to Google, especially if they start all looking the same.

If this is an isolated occurrence, though, it's a lot of trouble for a relatively minor problem. It would take a pretty deep knowledge of your product inventory and site structure to know for sure, but my gut reaction is that this is a small issue.

[chandubaba]

So right now what should i do to solve this problem ?

[Dr-Pete]

I talked to the technical team. The screen may be a bit confusing. Your "items_per_page" variations are not being flagged as a duplicate of "/hard-disk/portable-hard-disk/". All of the pages (including the items_per_page variants) are being flagged as near-duplicates (95%+) of "/hard-disk". Basically, since those pages show the exact same products and only differ by a header, we're flagging them as being too similar. Once we do that, then all of the other pages that canonical to the "/portable-hard-disk" page also look like near-duplicates of "/hard-disk".

It's not catastrophic, but if you have enough of these category/sub-category search pages that overlap on their results, you may want to reconsider whether you index all of them. At small scale, it's not a big deal. At large scale, these very similar pages could dilute your ranking ability.

[Dr-Pete]

We don't currently have a way to ignore warnings/errors, although I know that's on the wish list. Let me ping the Product Team on this one and see if they have any additional insight.

[chandubaba]

Then how can I rip off from seomoz crawler those links ?

[Dr-Pete]

As best I can tell, your canonical tags are properly implemented and Google doesn't seem to be indexing any URLs with "items_per_page" in them. Our crawler and desktop crawlers may be getting confused because there are internal paths to these variations.

Ideally, that pulldown probably shouldn't be crawlable, but I think your canonical implementation as it stands is ok. I don't see any evidence that Google is having problems with it. It may just be a false alarm on our part.

[NitinRGoyal]

SEO spider is showing meta descriptions and is not saying that content is duplicate. It means it is not checking rel canonical on these pages as well. So it is not an issue.

Note that duplicate title / desc does not mean content is duplicate.

Tools which are looking at one thing only will give this issue. Tools which are specific for finding duplicate content will not give an issue.

[chandubaba]

I also checked through Xenu and Screaming Frog Spider and both are showing the same thing. Check the attachment

http://i.imgur.com/HA09eNc.png

HA09eNc.png

[NitinRGoyal]

But the pages were there before add-on was added. Right ?

If they were then the Google may have crawled them and SEOMoz may have picked them from Google or some other engines which resulted in the issue.

So I suggest to wait and watch as you will get Crawl Errors every week from SEOMoz.

[chandubaba]

I Installed the add-on before the product was added.

[NitinRGoyal]

As of now your rel="canonical" immplementation looks fine. So these errors may have been  found when you were not using rel="canonical" and you were not using AJAX for showing the different number of results.

You should wait for next weeks results and the results should come fine.