Hreflang tags and canonical tags - might be causing indexing and duplicate content issues
-
Hi,
Let's say I have a site located at https://www.example.com, and also have subdirectories setup for different languages. For example:
https://www.example.com/es_ES/
https://www.example.com/fr_FR/
https://www.example.com/it_IT/
My Spanish version currently has the following hreflang tags and canonical tag implemented:
My robots.txt file is blocking all of my language subdirectories. For example:
User-agent:*
Disallow: /es_ES/
Disallow: /fr_FR/
Disallow: /it_IT/
This setup doesn't seem right. I don't think I should be blocking the language-specific subdirectories via robots.txt
What are your thoughts?
Does my hreflang tag and canonical tag implementation look correct to you? Should I be doing this differently?
I would greatly appreciate your feedback and/or suggestions.
-
Hi... I'm sorry to tell you that the answer offered by Gaston is not totally correct.
So, in your Spanish page you have these hreflang and canonical annotations:
This is not correct because you are not adding also the self-referential hreflang annotation
Google is very precise about this, and it states its need in the help pages as well in many Googlers tweets and webmaster office hangouts.
The rel="canonical" is correct. Remember that the self-referential and the alternative href URLs must always be canonicals.
Finally, regarding the subfolders blocked via robots.txt, yes! that's totally incorrect:
if you're blocking Googlebot from accessing the Spanish, French and Italian subfolders, then Googlebot won't be able to parse the code of their pages, hence it won't be able to see also the hreflang annotations... with obvious erroneous consequences.
-
that's corect.
-
Yes. example.com/en-US/ redirects 301 to example.com
So, when referencing that version in hreflang will it look like this?
Is this correct?
-
So, every page of example.com/en-US/ redirects 301 to example.com/ ?
If that's the case, then there is no reason in having that folder (/en-US/), just when configuring Hreflang for en-US use the URL without that folder
-
What do you mean by "exactly the same then there should not be 2 sites"?
My https://www.example.com/en-US/ 301 redirects to https://www.example.com
Thoughts?
-
Yeap, those implementations are correct.
in order to avoid duplicate content between different language/countries websites, in each page that is present on each site, there should be their corresponding hreflang tag.
In your case:
And for a sample page: https://www.smarttechMKT.com/es-ES/gastonriera-espanolNOTE, in the case that site.com and site.com/en-us/ are exactly the same then there should not be 2 sites. Just the one without the folder and hreflang tag with en-US should point to that
Hope it helps.
Best luck.
GR -
Thank you for the response, Gaston! I really appreciate it.
So you are certain that my hreflang and canonical tags are implemented correctly? For example, my Spanish version (https://www.example.com/es_ES/
Is this implementation correct?
Also, will I have any duplicate content issues with these different language versions?
-
Hello there,
Watch out your question, there is a site there. If its your clients, edit it.
Canonical and hreflang seems OK.
Blocking other languages/countries is wrong. There you are allowing google to see ONLY the us version.For further reading, take a look at these articles:
Hreflang:
Multi-regional and multilingual sites - Google Search Console
International checklist - Moz Blog
Using the correct hreglang tag - Moz Blog
Guide to international website expansion - Moz Blog
Tool for checking hreflang anotations - Moz Blog Canonicals:
SEO Best Practices for Canonical URLs + the Rel=Canonical Tag - Whiteboard Friday Consolidate duplicate URLs - Google Search Console HelpHope it helps.
Best Luck.
GR.Hope it helps.
Best luck.
GR.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
"Duplicate without user-selected canonical” - impact to SERPs
Hello, we are facing some issues on our project and we would like to get some advice. Scenario
International SEO | | Alex_Pisa
We run several websites (www.brandName.com, www.brandName.be, www.brandName.ch, etc..) all in French language . All sites have nearly the same content & structure, only minor text (some headings and phone numbers due to different countries are different). There are many good quality pages, but again they are the same over all domains. Goal
We want local domains (be, ch, fr, etc.) to appear in SERPs and also comply with Google policy of local language variants and/or canonical links. Current solution
Currently we don’t use canonicals, instead we use rel="alternate" hreflang="x-default": <link rel="alternate" hreflang="fr-BE" href="https://www.brandName.be/" /> <link rel="alternate" hreflang="fr-CA" href="https://www.brandName.ca/" /> <link rel="alternate" hreflang="fr-CH" href="https://www.brandName.ch/" /> <link rel="alternate" hreflang="fr-FR" href="https://www.brandName.fr/" /> <link rel="alternate" hreflang="fr-LU" href="https://www.brandName.lu/" /> <link rel="alternate" hreflang="x-default" href="https://www.brandName.com/" /> Issue
After Googlebot crawled the websites we see lot of “Duplicate without user-selected canonical” in Coverage/Excluded report (Google Search Console) for most domains. When we inspect some of those URLs we can see Google has decided that canonical URL points to (example): User-declared canonical: None
Google-selected canonical: …same page, but on a different domain Strange is that even those URLs are on Google and can be found in SERPs. Obviously Google doesn’t know what to make of it. We noticed many websites in the same scenario use a self-referencing approach which is not really “kosher” - we are afraid if we use the same approach we can get penalized by Google. Question: What do you suggest to fix the “Duplicate without user-selected canonical” in our scenario? Any suggestions/ideas appreciated, thanks. Regards.0 -
Duplicate store (subdomain) not ranking
I have a store ( www.grocare.com ) and I made a duplicate store recently ( in.grocare.com ) for a different region. Both have different currencies and target different regions. I even targeted the new store ( in.grocare.com ) to that particular country in google search console. They both have different href lang tags to mark different regions too. Now its been a month since this has been done. But the new store is not ranking in the region. The old one is still ranking and I have to redirect the traffic from old to new based on IP.
International SEO | | grocare
I thought making a new store and targeting specifically would help with rankings. Am i doing something wrong here?0 -
Migrating to a tag-driven global website - Need opinions!
We currently have a global site that is set up this way: Subfolders to designate countries. Content in same language is re-published on other country websites. Since we are re-launching at the end of the year, we are doing away with re-publishing content on different country sites and will just maintain a single copy of our content (to be populated on different pages using content tags). We are planning on doing this so that there is no need to apply href-lang tags on our content. My questions: Is maintaining just a single instance of an article good for a global website? What are the possible complications that may come up from this approach? Since there is only one version of the article that is being indexed, is a rel-canonical tag even needed? Should href-lang tag still be applied to high level pages (homepage, etc) to ensure that the correct homepage shows up in the appropriate geography? This question is quite long, so any feedback will be helpful. Thanks!
International SEO | | marshdigitalmarketing0 -
Hreflang no return tags error in GWT
Hello everybody, It has been 2 month since I'm trying to figure out the cause of increasing "no return tags" error count in GWT. I have checked the syntax several times and even switched from meta tags method to including language versions in sitemap without any luck. Below is a screen shot of GWT error and a sitemap excerpt that shows original and alternate URL both having return tags pointing to each other. The full sitemap can be found here: http://wordsru.com/sitemap.xml Any help or insight about whats going on here much appreciated. Thanks! RKP6AhZ.jpg KFluNCC.jpg
International SEO | | Icemax0 -
Links metrics & rel="alternate" hreflang="x"
Bonjour! If with rel="alternate" hreflang="x" we can indicate to Google that an URL have translated equivalents of a page, are the links metrics splited between all pages or Google considers all the pages as only one? Thanks! Maxime
International SEO | | Maxoulala0 -
Geographical targeting and rel=”alternate” hreflang=”x”
Let me paint you a picture, a site attempts geographical targeting by using sub-directories. However, 'targeting' is used loosely in this case. One sub-directory targets the US, the other is for everywhere else. For example: example.com/us/ <-- US example.com/en/ <--- Everywhere else The homepage is a map, they get taken to the US site if they click on US, they get the other site if they click anywhere else. The site is effectively duplicated in both folders, the only difference being one is written in US English, the other in UK English. So, while I am able to set the preferred geo in Google Webmaster tools for the US site, I can't for the everything else site. Recently I came across rel=”alternate” hreflang=”x” and thought it may be useful. Does anyone know if I can specify more than one language per URL using this method? For example using multiple instances such as: Is this possible at all? Thanks in advance, and I'm open to any other suggestions! 🙂
International SEO | | David_ODonnell0 -
Geo targeting issue and hosting
Hi guys and gals, this is not a problem per se, but an oddity that I would appreciate some insight on from the big juicy brains in this community. Our site had hosting in the US, and I was concerned that therefore our relevance to our own country (Australia) was diminished because of it. For one of our main keywords we were a few spots behind the competitor on the 1st page for an australian searcher, but when i searched the same keyword from Google.com with gl=us to show US only results, we outranked the competitors by a few spots. On page elements aside (if anything we had more geo identifiers on the ranking page in question) I wanted to move hosts anyway and got hosting in Australia. The next week our search traffic jumped by 25%. But it was almost all US traffic. Australian traffic was unchanged. Any idea how this could happen? It's an .AU domain, hosted in Australia, with on page clearly identifying Australia. I checked webmaster tools and our geo is properly set to Australia. I checked the keywords that the traffic increased for and they are not geo specific at all. Besides that I don't know how else to pin this down. Thanks.
International SEO | | Digital3600 -
Does hosting content for one country in another country negatively affect its SEO ranking?
Hi, my content is primarily for Australian audiences, however due to a general lack of competitive hosting infrastructure, I tend to host a lot of content in the US. A 2007 article I read implied that it's not a good idea - does anyone have a definitive 2011 answer? Cheers, Jez
International SEO | | jez0000