Why Does SEOMOZ Crawl show that i have 5,769 pages with Duplicate Content

[Prime85]

Hello...

I'm trying to do some analysis on my site (http://goo.gl/JgK1e) and SEOMOZ Crawl Diagnostics is telling me that I have 5,769 pages with duplicate content.

Can someone, anyone, please help me understand:

1. how does SEOMOZ determine if i have duplicate content

2. Is it correct ?  Are there really that many pages of duplicate content

3. How do i fix this, if true <---- ** Most important **

Thanks in advance for any help!!

[lavellester]

Looks like its now sorted!

Checked link: http://www.plasticstorage.com/

Type of redirect: 301 Moved Permanently

Redirected to: http://plasticstorage.com/

[Prime85]

Hey Lavellester,

I believe we got our 302/301 issue resolved.  Any way you can check through whatever tool you were using last week?

We are still trying to figure out how to fix the code creating the dupe content, but can you advise if i fixed the redirect properly?

Thanks,

[lavellester]

it will be related to the code/logic of your site creating the duplicate pages.  You could work out why/update the code so you only have 1 page for each product OR you could use the rel canonical tag to resolve the issue.

Just thought...as you appear to have so many duplicate pages it may be quicker to look at the logic of the site and fix it all in one go.

[Prime85]

Lavellester, thanks for all of your help, i am going to have that redirect changed to a 301 ASAP.

Do you have any idea where that duplicate content is coming from since i only have that item in my database once?

Thanks

[lavellester]

The redirect is still a 302:

Checked link: http://www.plasticstorage.com/

Type of redirect: 302 Moved Temporarily

Redirected to: http://plasticstorage.com

Change the type of redirect to a 301 - this is done at the server level usually.

[lavellester]

Unless I'm mistaken they appear to be identical duplicate pages.

[Prime85]

little update:

In our GWT we have both the www version and the non www version.

On the non, we had set the preferred domain as the non www

On the WWW, we also had set the preferred domain as the non www

Does this mean I've done it correctly or not?

Thanks

[Prime85]

I am looking into the 301/302 issue right now and i will report back...

Here are 3 supposed duplicate content pages:

<colgroup><col width="64"></colgroup>
|

plasticstorage.com/305b1.html

plasticstorage.com/catalog/product/view/id/5079/s/305b1/category/100/

plasticstorage.com/catalog/product/view/id/5079/s/305b1/category/101/

|

|

<colgroup><col width="64"></colgroup>
|

Those pages when entered into your browser will appear identical... There is only one 305b1 item in the database.  Somehow you can change the "100" or the "101" to "166666662" and you will still see that same "305b1" item.... Can you please help me figure out how or why and is this the "DUPLICATE CONTENT" or perhaps something else is being considered...

Thanks again

|

|

[lavellester]

I'd still strongly recommend fixing the 301 redirect.  The preference in the GWT tools is kinda like a soft preference.

Can you show 2 URSs that are deemed to be the same/duplicate?

[Prime85]

We have set the canonical through Google to choose the non www version

Some examples of pages that are deemed duplicate is:

Page Title
URL	Other URLs	Page Authority	Linking Root Domains

Ultra-Clear InSight Bin - Stacking 10x5x5 305B1 Akro-Mils

http://plasticstorage.com/305b1.html	50+	15	1

Lids for Ultra-Clear InSight Bin - 305B1 - Akro-Mils 305B2

http://plasticstorage.com/305b2.html?related=1	50+	1	0

Dividers for Ultra-Clear InSight Bin - 305B1 - Akro-Mils 405B1

http://plasticstorage.com/405b1.html?related=1 | 50+ | 1 |
|

[lavellester]

Hi there,

One issue is that your www.plasticstorage.com is a 302 redirect to plasticstorage.com.  You should update this to a 301 redirect.  This will be causing a few issues.

I think the SEOMoz tool shows content that it deems duplicate in the report.  Can you post some examples of pages that are deemed duplicate?

Cheers.

[msperformance]

I also had duplicate content. The cause was I have 2 similar domains that both led to the same page. Mine were  (1) www.msperformanceonline.com &  (2) w/o the " www." just msperformanceonline.com  Look and see if this is why.