How do I fix these duplicate URLs?
-
HI guys, I ran a report on my site and it shows some duplicate titles (example below).
Do I need to add something to the htaccess file or another file to fix this? I understand that the search engines should only see 1 URL for the page.
2 pages have "Bikes for sale | used bikes | second hand bicycles" title
paulswebsite.com/bikes/index.asp
Thanks
-
You have two changes I think you need to do. As Woj Kwasi says, you have URLs with and without "www.".
I would most definately redirect the non-www traffic to www-URLs. Add the redirect in your .htaccess:
RewriteEngine On
RewriteCond %{HTTP_HOST} ^thegorillafirm.com [NC]
RewriteRule ^(.*)$ http://www.thegorillafirm.com/$1 [L,R=301]
Furthermore you need to set canonical links:
http://thegorillafirm.com/bikes/">
This should be set in the index.asp file header. In a similar way you should set this for:
http://thegorillafirm.com/surf/
http://thegorillafirm.com/snow/This should help you remove the duplicate content warnings.
Best regards,
Rasmus
-
As Autobytel mentioned, specifying the canonical would be the way to go.. considering you also have www & non www versions:
-
Agree
-
Set your canonical tags
http://googlewebmastercentral.blogspot.com/2009/02/specify-your-canonical.html
-
One take on this would be to add a 301 redirect one of the URLs onto to the other. As Vjay mentioned this would look after any inbound links to the page.
this post has some good info also
http://www.seomoz.org/blog/301-redirect-or-relcanonical-which-one-should-you-use
-
hello, it depends,
1. what is the site built on, if its something like wordpress its an easy fix. you may want to think about the links coming in.
2. Use the on page optimiser to get more insight - pro tools .
hope this helps, I am by no means a know it all but there is my take on it.
best,
Vijay
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Some URLs in the sitemap not indexed
Our company site has hundreds of thousands of pages. Yet no matter how big or small the total page count, I have found that the "URLs Indexed" in GWMT has never matched "URLS in Sitemap". When we were small and now that we have a LOT more pages, there is always a discrepancy of ~10% or so missing from the index. It's difficult to know which pages are not indexed, but I have found some that I can verify are in the Sitemap.xml file but not at all in the index. When I go to GWMT I can "Fetch and Render" missing pages fine - it's not as though it's blocked or inaccessible. Any ideas on why this is? Is this type of discrepancy typical?
Technical SEO | | Mase0 -
Special characters in URL
Will registered trademark symbol within a URL be bad? I know some special characters are unsafe (#, >, etc.) but can not find anything that mentions registered trademark. Thanks!
Technical SEO | | bonnierSEO0 -
Are duplicate page titles fixed by the canonical tag
Google Web Master Tools is saying that some of my pages have duplicate page titles because of pagination. However, I have implemented the canonical tag on the paginated pages which I thought would keep my site from being penalized for duplicate page titles. Is this correct? Or does canonical tag only relate to duplicate content issues?
Technical SEO | | Santaur0 -
SEOMOZ and non-duplicate duplicate content
Hi all, Looking through the lovely SEOMOZ report, by far its biggest complaint is that of perceived duplicate content. Its hard to avoid given the nature of eCommerce sites that oestensibly list products in a consistent framework. Most advice about duplicate content is about canonicalisation, but thats not really relevant when you have two different products being perceived as the same. Thing is, I might have ignored it but google ignores about 40% of our site map for I suspect the same reason. Basically I dont want us to appear "Spammy". Actually we do go to a lot of time to photograph and put a little flavour text for each product (in progress). I guess my question is, that given over 700 products, why 300ish of them would be considered duplicates and the remaning not? Here is a URL and one of its "duplicates" according to the SEOMOZ report: http://www.1010direct.com/DGV-DD1165-970-53/details.aspx
Technical SEO | | fretts
http://www.1010direct.com/TDV-019-GOLD-50/details.aspx Thanks for any help people0 -
Duplicate page content
Hello, The pro dashboard crawler bot thing that you get here reports the mydomain.com and mydomain.com/index.htm as duplicate pages. Is this a problem? If so how do I fix it? Thanks Ian
Technical SEO | | jwdl0 -
Duplicate Content
Many of the pages on my site are similar in structure/content but not exactly the same. What amount of content should be unique for Google to not consider it duplicate? If it is something like 50% unique would it be preferable to choose one page as the canonical instead of keeping them both as separate pages?
Technical SEO | | theLotter0 -
Is there actual risk to having multiple URLs that frame in main url? Or is it just bad form and waste of money?
Client has many urls that just frame in the main site. It seems like a total waste of money, but if they are frames, is there an actual risk?
Technical SEO | | gravityseo0 -
Duplicate homepage content
Hi, I recently did a site crawl using seomoz crawl test My homepage seems to have 3 cases of duplicate content.. These are the urls www.example.ie/ www.example..ie/%5B%7E19%7E%5D www.example..ie/index.htm Does anyone have any advise on this? What impact does this have on my seo?
Technical SEO | | Socialdude0