Multilingual website - Url problem (sitemap)
-
At this moment our website both uses the language in the url like "en" and localizes the url itself ("books" in english and "boeken" in dutch). Because of the history of making our website multilingual we have a system that takes the browser language for the localization if the url doesn't contain a language like "en".
This means:
- www.test.com/books = browser language
- www.test.com/en/books = english language
- www.test.com/boeken = browser language
- www.test.com/nl/boeken = dutch language
Now for the sitemap this makes it a little troublesome for me because which hreflang is used for which url?
1) The first thing I thought of was using x-default for all urls that get the language of the browser.
<code><url><loc>http://www.test.com/books</loc></url></code>
But as you can see we now got 2 times x-default.
2) Another solution I thought of was just use the localization of the url to determine the language like:
<code><url><loc>http://www.test.com/books</loc></url></code>
But now we got 2 of each language for the same page.
3) The last solution I thought of was removing links without a language in the url (except for the homepage, which will still have an x-default) like:
<code><url><loc>http://www.test.comen/books</loc></url></code>
But for this solution I need to put 301's at pages that are "deleted" and also need to change the system to 301 to the right page. Although the last point isn't really a problem I'm kind of worried that I will lose some of the "seo points" with a 301. (When we changed our domain in the past we had a bad experience with the 301 of our old domain)
What do you think would be the best solution for SEO? Or do you have any other suggestions or solutions I haven't thought of.
-
The best way to go about this is to keep the URLs with the language in the structure. Redirect (301) the ones that don't have it to the ones that do.
However, it sounds like that causes a problem. If the above isn't a possibility, use a canonical from the non-language URL to the one with it. Then do your HREFLANG in sitemaps, and only use the URLs with the language tag in the sitemaps. You can also do the coding on the page, just make sure the HREFLANG tags are not on the non-language pages.
- Example URL: http://www.test.com/boeken would have a canonical tag that points to http://www.test.com/nl/boeken
- Only http://www.test.com/nl/boeken is listed in the sitemaps
- OR Only http://www.test.com/nl/boeken has HREFLANG tags. http://www.test.com/boeken would only have the canonical.
That should solve your problem.
-
From their support page (https://support.google.com/webmasters/answer/189077?hl=en) when you're combining region plus language you'll want to do this:
For example, you may have specific URLs for English speakers in Ireland (en-ie), Canada (en-ca), and Australia (en-au), but want all other English speakers to see your generic English (en) page, and everyone else to see the homepage. In this case you should specify the generic English-language (en) page for searchers in, say, the UK. You can annotate this cluster of pages using a Sitemap file or using HTML link tags like this:
That way you can even have a situation like nl-en or vice versa. I'd use 302s for redirecting based on conditional things like browser settings. Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Hreflang implementation via sitemap - don’t need canonical tags?
Hi, Quick easy question here I hope! An international site has hreflang and canonical tags in page head sections and also hreflang in the sitemap so I can see one version needs removing. The head section versions are relative URLs and need updating so think we will keep the sitemap hreflangs instead. If the sitemap implementation is going to be used (sitemap auto-updates when changes are made to pages so seems easier to do this way) am I right in thinking No canonical tags are needed at all (and can safely be removed from head section too?). Pretty sure links included in sitemap are assumed to be canonicals, or any issues with this approach? Will be using x-default for the default language version of homepage too.
International SEO | | MMcCalden0 -
Multistore Sitemap
I use Magento 2 Multistore and have 2 stores set up with identical products, one for the EU and one for the US. The best practice is to allow Google to crawl both sites, but what about the sitemap? Should I only include one store? The reason I ask is that Google has recently started ignoring canonicalized URLs, so even though the second store is canonicalized, it could affect my rank. My rank did drop with the last update when this was rolled out, I stopped some canonicalized URLs from generating and my rank went back up (albeit not as high as before).
International SEO | | moon-boots0 -
Auto-Redirecting Homepage on Multilingual Site
The website has an auto-redirecting homepage on a multilingual site. Here is some background: User visits the site for first time > sent to javascript age verification page with country of origin selector. If selects "France" then served French page (.com/fr-fr/). If selects any other country, then served English page (.com/en-int/). A cookie is set, and next time the user visits the site, they are automatically served the appropriate language URL. 1st Question: .com/ essentially does not exist. It is being redirected to .com/en-int/ as this is the default page. Should this be a 301 redirect since I want this to serve as the new homepage? 2nd Question:. In the multilingual sitemap, should I still set .com/ as the hreflang="x-default" even though the user is automatically redirected to a language directory? According to Google, as just released here: http://googlewebmastercentral.blogspot.com/2014/05/creating-right-homepage-for-your.html "automatically serve the appropriate HTML content to your users depending on their location and language settings. You will either do that by using server-side 302 redirects or by dynamically serving the right HTML content. Remember to use x-default rel-alternate-hreflang annotation on the homepage / generic page even if the latter is a redirect page that is not accessible directly for users." So, this is where I am not clear. If use a 302 redirect of .com/ to either .com/en-int/ or .com/fr-fr/, won't I then lose the inbound link value and DA/PA of .com/ if I just use a 302? Note: there is no .com/ at this moment. Any advice is appreciated. Thanks,Alex
International SEO | | Alex.Weintraub0 -
Multilingual Site with 2 Separate domains and hand-translated
I have 2 separate domains: .com & .jp
International SEO | | khi5
I am having a professional translator translate the English written material from .com. However, the .jp will have same pictures and videos that I have on the .com which means alt tags are in English and video titles are in English. I have some dynamic pages where I use Google Translate and those pages I place as "no index follow" to avoid duplicate issues and they are not very important pages for me any way. Question: since I am doing a proper translating - no machines involved - can I leave pages as is or should I include any format of these: ISO language codes
2) www.example/com/” /> Even though hand translated, the translation will probably be 85% similar to that if I used Google Translate. Will that potentially be seen as duplicate content or not at all since I have not used the Google Translate tool? I wonder from which angle Google analyses this. Thank you,0 -
Do we need to update our sitemaps each time our content changes?
Dear SEO experts! We have created sites maps to get our international sub-domains indexed, however we're unsure if we have to update our sitemaps each time our content changes on our many landing pages which are translated to 17 different languages? Obviously the goal is to make it dynamic so it updates itself. I hope you can help us with some advice. Thanks a lot! Allan
International SEO | | Todoist0 -
Naming URL for Russian version of the site
Hi, Our site has two languages: English and Russian. My question is that should I use Cyrillic letters in the URL structure and file naming of the Russian version of the site, as Russian users are searching for information by using Russian words not English words? Thanks in advance, Sam
International SEO | | Awaraman0 -
Backlinks to rewrite urls and russian cyrilic characters
Dear Mozers, I've been tried different methods for backlink building and I need some help in order to make it clear in my mind. I have a multilingual website. Also it has russian language which is our basic market. My main keyword is(Недвижимость в Греции) which means Properties in Greece and of course I target my russian first page which has url rewrite (because I have to include my keywords in url) with cyrrilic characters - http://www.halkidikiproperties.com/ru/халкидики-недвижимость-греции/. As I see these backlinks doesn't appear in seomoz tool and there is no improvment in link analysis tab. Do I have to target better my home page than this url rewrited page or maybe do I have to target www.halkidikiproperties.com/ru/ which is the main russian page but before the url rewrite? Also as I see my competitors targeting their homepage without any rewrite but they are not multilingual. Do I have to analyze better this specific rewrited-url by using Link analysis tool? Is it possible to analyze a specific url? Thank a lot , It will be really helpful your assistance. Regards, George
International SEO | | elgreco0 -
International (foreign language) URL's best practices
I'm curious if there is a benefit or best practice with regards to using the localized language on international sites (with specific ccTLDs). For example, should my french site (site.fr) use the french language as keywords within the URLs or should they be in english? e.g. www.site.fr/nourriture vs. www.site.fr/food Is that considered best practice for SEO (or just for brand perception those markets?). Is there a tangible loss in SEO if we do not use the correct language for those URLs and just stick with English around the world? I recall seeing a Matt Cutts video on the topic and he said that google does support i18n URL's but other SE's might not support them as gracefully but he didn't come down with a hard recommendation to go with i18n URL's or just English. Would love a strong ruling in favor one direction based on best practices.
International SEO | | mongillo0