Duplicate content

[bhanu2217]

crawler shows following links as duplicate

http://www.mysite.com

http://mysite.com

http://www.mysite.com/

http://mysite.com.

http://mysite.com/index.html

How can i solve this issue?

[MalcolmGibb]

Try this:

RewriteEngine on

<code>RewriteCond %{THE_REQUEST} ^.*\/index\.html?\ HTTP/
RewriteRule ^(.*)index\.html?$ "/$1" [R=301,L]</code>

[bhanu2217]

This works.Now non www. to www redirection is set. Thanks

now how do i solve this

www.mysite.com

www.mysite.com/index.html

will your above code solve this one also?

[MalcolmGibb]

try adding this to your .htaccess

RewriteEngine On
RewriteCond %{HTTP_HOST} ^princetown.in
RewriteRule (.*) http://www.princetown.in/$1 [R=301,L]

[bhanu2217]

I added following line to .htaccess

RedirectPermanent /index.html http://www.mysite.com/

Now whenever i open homepage i getting following message

Moved Permanently

The document has moved here.

[bhanu2217]

Do i do it one by one?

Can i set all non www URL to www?

[MalcolmGibb]

Google essentially sees those 5 domains as individual sites and will list each as individual sites in results.

Follow the guide bjgomer liks you to, you need to set up your .htaccess file to resolve www and either finishwith a trailing slash or index.html the former usually being the better. You also need to decide first whether you want your site to be http://mysite.com or http://www.mysite.com.

[BrianJGomez]

Setup a 301 re-direct in your .htaccess file that designates the 'official' home page url. This will eliminate the crawl errors.

http://www.bruceclay.com/blog/2007/03/how-to-properly-implement-a-301-redirect/