Why is there duplicates of my domain
-
When viewing crawl diagnostics in SEOmoz I can see both "www.website.com" and a truncated version "website.com" is this normal and why is it showing (I do not have duplicates of my site on the server)?
E.g.:
-
Hi All,
I have just altered my Google Webmaster tools in the Config (as per Geoff's advice above) and that appears to be fine for now. However, I have also updated my ".htaccess" file dong a 301 redirect, details below:
Options +FollowSymLinks
RewriteEngine onRewriteCond %{HTTP_HOST} !^www. [NC]
RewriteRule ^ http://www.%{HTTP_HOST}%{REQUEST_URI} [L,R=301]I also have recently changed my pages from .html to .php do I redirect by using this code as I want all old links to now refer to the .php file:
RewriteRule (.*).html$ /$1.php [R=301,L]
Lastly, Thomas on the canonical side of things, is it necessary for me to implement this in the Head?
How can I see if the work completed is correct or check that it works?
Paul.
-
Ok, I have implemented the Google Webmaster redirect. and now I have tried the edit to the .htaccess file trying both options below with no success.
Option 1:
AddHandler php-stable .php
RewriteEngine On
RewriteCond %{HTTP_HOST} !^www.RewriteRule ^(.*)$ http://www.%{HTTP_HOST}/$1 [R=301,L]Option 2:
AddHandler php-stable .php
Options +FollowSymLinks
RewriteEngine on
RewriteRule (.*) http://www.klinehimalaya.com/$1 [R=301,L]Neither seem to be working when viewed here:
http://anythinghere.klinehimalaya.com/Please help.
Thanks
-
Hey Mat,
Another question. If I have changed a page address from:
http://www.klinehimalaya.com/packages.html to
http://www.klinehimalaya.com/packages.phpwill I also need to redirect the pages I have changed from .html to .php or is this not needed because I have not changed the file name prior to the prefix?
Thanks.
Paul.
-
You can set the preferred domain just like Geoff mentioned. But basically since you have a www version and a non www version it can be seen as duplicate content. Although the site is only one website and changes will appear on each the URL structure changes for depending on if you use the www or non www and therefore it looks like duplicate content.
-
I have checked out your website we you may not have implemented the 301 redirect correctly. In addition you should use Google Webmaster tools along with
rel="canonical"
http://www.seomoz.org/blog/how-to-advanced-relcanonical-http-headers
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=139394
Add a
rel="canonical"
link to the section of the non-canonical version of each HTML page.To specify a canonical link to the page http://www.example.com/product.php?item=swedish-fish, create a element as follows:
Copy this link into the section of all non-canonical versions of the page, such as http://www.example.com/product.php?item=swedish-fish&sort=price.
If you publish content on both http://www.example.com/product.php?item=swedish-fish and https://www.example.com/product.php?item=swedish-fish, you can specify the canonical version of the page. Create the element:
Add this link to the section of https://www.example.com/product.php?item=swedish-fish.
-
Hi,
If I was you I would go into Google Webmaster tools and verify both versions of the site, then go to Configuration >> Setting >> Preferred domain and tell Google your preference.
You will need to do this with both verified versions of the domain. You can then delete the listing for the one you do not want
You will only need one Google Verification code.
That will sort the issue with Google
Geoff
-
You have fixed the redirect loop, but the initial problem still exists. With the urgent issue now fixed (I can see the site now!) let's look at the problem:
You don't actually have a live problem at the moment, so any fix here will not improve your results. However you have a potential problem - one that could occur and cause you problems later. It's not hard to fix, so it is good to get it done.
Your server (like many) is set up to serve the same files to both klinehimalaya.com and www.klinehimalaya.com, which are technically different addresses. If google followed a link to klinehimalaya.com and a link to www.klinehimalaya.com if would find the content at two seperate places and could index both and consider them to be duplicate. Yes... all those PHDs and Google is still that stupid.
What you need to do (and I think you were trying to do this) is to pick one version of that address as the one that you are going to use. You can then redirect traffic from the other version to the chosen version.
In fact anythinghere.klinehimalaya.com is also serving up the same site, so you should fix the lot in one go.
If you are running apache (most sites are) then you can do this with an .htaccess redirect . There is a good example of how to do this at the top of this page: http://dense13.com/blog/2008/02/27/redirecting-non-www-to-www-with-htaccess/
In short it checks to see whether the address being loaded starts with www. . If it doesn't then it loads that version via a 301 redirect.
The issue Ross has pointed out is separate and not fixed by this. You should do both.
I hope that helps.
-
You are linking to your home page via your logo in the header.
However you are linking to this address http://www.klinehimalaya.com/index.php try linking to this address http://www.klinehimalaya.com/
This will remove your duplicate content issue.
-
Think I just fixed the redirect, but I still have an issue in SEOmoz where it is still pulling up both references to:
http://www.klinehimalaya.com/index.php
klinehimalaya.com/index.phpApparently this will effect my SEO efforts, hot to fix!!!
Thanks all!
-
I tried to look at this for you, but you have some issues on your site that are stopping me viewing it completely.
Both klinehimalaya.com and www.klinehimalaya.com create an infinite loop that prevents the page loading. klinehimalaya.com is correctly 301ing to www.klinehimalaya.com
However www.klinehimalaya.com is redirecting to itself.
You need to fix that URGENTLY. Start by looking at your htaccess file.
-
You need to do a 301 redirect
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Decline in traffic and duplicate content in different domains
Hi, 6 months ago my customer purchased their US supplier and moved the supplier's website to their e-commerce platform. When moving to the new platform they copied the descriptions of the products from their site to the supplier's site so now both sites have the same content in the product pages. Since then they have experienced decrease in traffic in about 80%. They didn't implement canonical tag or hreflang. My customer's domain format is https://www.xxx.biz and the supplier's domain is https://www.zzz.com The last one is targeting the US and when someone from outside of the US wants to purchase a product they get a message that they need to move to the first website, the www.xxx.biz. Both sites are in English. The old site version of www.zzz.com, before the shit to the new platform, contained different product descriptions, and BTW, the old website version is still live and indexed under a subdomain of www.zzz.com. My question is what's the best thing to do in this case so that the rankings will be back to higher positions and they'll get back their traffic. Thanks!
Technical SEO | | digital19740 -
Duplicate Page Content
Hello, After crawling our site Moz is detecting high priority duplicate page content for our product and article listing pages, For example http://store.bmiresearch.com/bangladesh/power and http://store.bmiresearch.com/newzealand/power are being listed as duplicate pages although they have seperate URLs, page titles and H1 tags. They have the same product listed but I would have thought the differentiation in other areas would be sufficient for these to not be deemed as duplicate pages. Is it likely this issue will be impacting on our search rankings? If so are there any recommendations as to how this issue can be overcome. Thanks
Technical SEO | | carlsutherland0 -
Changing Domain Name
Hi all, A client has just got their .edu domain and they want to change their current domain name (a .com) to this new .edu domain. The domain's CMS is Wordpress. Please correct me if I'm wrong, but basically I will need to create a new site (but they want to keep current design), move everything across to the new domain name, and 301 URL per URL? What about all the citations that the old URLs have gotten? The website is listed on Google listings/maps for some of their local keywords. Is there anyway to preserve this? Thank you all in advance.
Technical SEO | | EdwardDennis0 -
Multiple domains on the same hosting
Hello, I have around 80 sites (different domains) which are on the same host. Everytime I look up the IP of these domains, it gives me the same IP. The sites are interlinked, all linking to the main domain. My question is: Does the off site link building have effect on the 80 sites?
Technical SEO | | Arianittt0 -
Duplicates on the page
Hello SEOMOZ, I've one big question about one project. We have a page http://eb5info.com/eb5-attorneys and a lot of other similar pages. And we got a big list of errors, warnings saying that we have duplicate pages. But in real not all of them are same, they have small differences. For example - you select "State" in the left sidebar and you see a list on the right. List on the right panel is changing depending on the what you selecting on the left. But on report pages marked as duplicates. Maybe you can give some advices how to improve quality of the pages and make SEO better? Thanks Igor
Technical SEO | | usadvisors0 -
Canonical usage and duplicate content
Hi We have a lot of pages about areas like ie. "Mallorca" (domain.com/Spain/Mallorca), with tabbed pages like "excursion" (domain.com/spain/Mallorca/excursions) and "car rental" (domain.com/Spain/Mallorca/car-rental) etc. The text on ie the "car rental"-page is very similar on Mallorca and Rhodos, and seomoz marks these as duplicate content. This happens on "car rental", "map", "weather" etc. which not have a lot of text but images and google maps inserted. Could i use rel=nex/prev/canonical to gather the information from the tabbed pages? That could show google that the Rhodos-map page is related to Rhodos and not Mallorca. Is that all wrong or/and is there a better way to do this? Thanks, Alsvik
Technical SEO | | alsvik0 -
I have a ton of "duplicated content", "duplicated titles" in my website, solutions?
hi and thanks in advance, I have a Jomsocial site with 1000 users it is highly customized and as a result of the customization we did some of the pages have 5 or more different types of URLS pointing to the same page. Google has indexed 16.000 links already and the cowling report show a lot of duplicated content. this links are important for some of the functionality and are dynamically created and will continue growing, my developers offered my to create rules in robots file so a big part of this links don't get indexed but Google webmaster tools post says the following: "Google no longer recommends blocking crawler access to duplicate content on your website, whether with a robots.txt file or other methods. If search engines can't crawl pages with duplicate content, they can't automatically detect that these URLs point to the same content and will therefore effectively have to treat them as separate, unique pages. A better solution is to allow search engines to crawl these URLs, but mark them as duplicates by using the rel="canonical" link element, the URL parameter handling tool, or 301 redirects. In cases where duplicate content leads to us crawling too much of your website, you can also adjust the crawl rate setting in Webmaster Tools." here is an example of the links: | | http://anxietysocialnet.com/profile/edit-profile/salocharly http://anxietysocialnet.com/salocharly/profile http://anxietysocialnet.com/profile/preferences/salocharly http://anxietysocialnet.com/profile/salocharly http://anxietysocialnet.com/profile/privacy/salocharly http://anxietysocialnet.com/profile/edit-details/salocharly http://anxietysocialnet.com/profile/change-profile-picture/salocharly | | so the question is, is this really that bad?? what are my options? it is really a good solution to set rules in robots so big chunks of the site don't get indexed? is there any other way i can resolve this? Thanks again! Salo
Technical SEO | | Salocharly0 -
Duplicate Content
We have a main sales page and then we have a country specific sales page for about 250 countries. The country specific pages are identical to the main sales page, with the small addition of a country flag and the country name in the h1. I have added a rel canonical tag to all country pages to send the link juice and authority to the main page, because they would be all competing for rankings. I was wondering if having the 250+ indexed pages of duplicate content will effect the ranking of the main page even though they have rel canonical tag. We get some traffic to country pages, but not as much as the main page, but im worried that if we remove those pages and redirect all to main page that we will loose 250 plus indexed pages where we can get traffic through for odd country specific terms. eg searching for uk mobile phone brings up the country specific page instead of main sales page even though the uk sales pages is not optimized for uk terms other than having a flag and the country name in the h1. Any advice?
Technical SEO | | -Al-0