Traffic drop after hreflang tags added
-
We operate one company with two websites each serving a different location, one targeting EU customers and the other targeting US customers.
thespacecollective.com (EU customers)
thespacecollective.com/us/ (US customers)
We have always had canonical tags in place, but we added the following hreflang tags two weeks ago (apparently this is best practice);
EU site (thespacecollective.com)
US site (thespacecollective.com/us/)
Literally the same day we added the above hreflang tags our traffic dropped off a cliff (we have lost around 70-80% on the EU site, and after a minor recovery, 50% on the US site). Now, my first instinct is to remove the tags entirely and go back to just using canonical, but if this is truly best practice, that could do more damage than good.
This is the only change that has been made in recent weeks regarding SEO. Is there something obvious that I am missing because it looks correct to me?
-
Thank you! Hopefully this resolves my issue
-
Yes, that looks correct now. And in your specific case, x-default might indeed handle the rest since Europe is your default, and that's where the unspecified combinations are most likely to be for you.
I wouldn't be too concerned about site speed. These are just links. They don't load any resources or execute any scripts. For most intents, it's similar to text. The main difference is that they will be links that may be followed by the bots. But really, even though you'll have many lines, you only really have two actual links among them. So, I wouldn't be too concerned about this part.
Good luck.
-
I think I understand, this is going to generate a lot of tags - this could be a problem for website speed.
UK/EU Site:
USA Site:
I'll see how the above goes, I can always add an English version as you suggest, but I think I have targetted the main languages here and hopefully the x-default will resolve the rest.
-
Moon boots. It looks like you decided to target by language, rather than by country-language combinations. And that is acceptible. It has a few issues, for example if you target by FR you are going to send both France and Candaian French speakers to your Europe site (and I don't think you are wanting to do this). On the other hand, if you were instead thinking that you were specifying the country code, no, the code you pasted here does not do that. Per the spec on hreflang, you can specify a language code without a country code, but you cannot specify a country code without a language code. All of the hreflang values you used will be interpreted as language, not country. So, for example, CA will be interpreted as Catalan, not Canada.
Again, I know it's a giant pain to handle all the EU countries. All of us wish Google made it feasible to target Europe as an entity, or at least target y country even. But it's just not the case. Yet. So, the way we do this is generally with application code. Ideally, in your case, I would suggest for that code to generate, for each country, one entry for English in that country (like "en-DE"), and another entry for the most common language in the country (like "de-DE"). That will generate many entries. But it's the only way I know of to effectively target Europe with an English language site.
-
Okay, I think I have it down correctly now:
UK/EU Site:
USA Site:
How does that look?
Yes, I was just using my home page as an example. Each page references its own URL, as opposed to every page referencing the home page URL - but thank you for pointing that out as it could have been easily overlooked!
-
moon-boots. Pretty close now. You should add the x-default to each site too, and they should be identical (whichever one of your sites you want to present for any locales you've omitted).
But also, realize that "en-it" is a pretty fringe locale. Google woudl only propose this to a search visitor from Italy who happened to have preferences set for English in their browser. While there are plenty of people in ITaly who do speak English, there are far fewer who set their browser to "en".
I have the same issue in Europe. Germany is one of our largest markets. I initially targeted, like you've done, just English in each country. We previously (a year ago) had a German-language site, and that one we targeted to "de-de". When we stopped maintaining the German-language site, we changed our hreflang tag to "en-de". We quickly found that all of our rankings dropped off a cliff in Germany. I would recommend, at least for your largest addressable markets, to also include hreflang tags for the primary languages. Thsi is another thing whcih Google hasn't yet made easy. They allow to target by language without country, but not by country without language. At least in hreflang (which was really developed for language targeting). GSC (the legacy version) had country-level targeting there.
Lastly, you included URLs for your home page here. But I'm assuming you realize you need to make the tags page-specific, on every page. If you put these tags as-is on every page, then you would be sending a signal to google equivalent to pointing every one of your site pages to a canonical of your home page (and effectively de-indexing the remainder of your site's pages). I'm assuming you're just using home page as an example in your posts. But if not, then yes, you will need to do page-specific tags for each page (and the self-referencing ones need to match your canonical tag for the page).
-
This is just getting overly complicated, Google need a more elegant solution.
I will try to add each of the EU countries to the EU site and ROW to the USA site. Is this how it should look?
UK/EU Site:
USA Site:
-
So, that's exactly why I wrote that you should include all the EU countries as specified locales, pointing to the EU site. Only everything "unspecified" goes to x-default. Alternatively, you could point AU, CA, NZ to the US site, and make x-default point to your EU site. I don't think that is as good of an approach though. Like I said, everyone who has a EU site has this issue. It's a pain that EU isn't a valid "locale" for hreflang. Maybe something will eventually be in place to handle better. In the interim, we can add hreflang for all the EU countries (or just prioritize the markets you really serve).
-
No, that's not a correct x-default implementation. It should point to the same URL on both sites. Wherever the non-specified locales should go (pick one).
The issue here is that Canada, Australia, New Zealand, etc. are redirected to the US site, while EU countries are redirected to the UK site. If I select one of the two, then won't all countries listed above be directed to the UK site?
-
No, that's not a correct x-default implementation. It should point to the same URL on both sites. Wherever the non-specified locales should go (pick one).
As far as reciprocal, Google checks that they are "reciprocal" in that each locale which is pointed to has hreflang tags which point back to the other site for its locale. There is no point in having hreflang tags only on one site.
And, you definitely shouldn't specify just "EN" because that would include the US too.
-
I have now added x-default to both sites, this is how they look:
The Space Collective UK/EU
The Space Collective USA
Does this look correct?
On the EU tags, there's not a "penalty". There's just no "Europe" locale. Since you need to specify valid locales, the only way I know of to scope "Europe" is to include all the locales (or at least the most popular ones. I generally add the primary language for each country, a few languages for countries such as Belgium, and sometime I add en-[country] for all of them if my EU site is in English only.
Also on the EU tags, you should not remove the EU tags and only tag the US site. Tags will all be ignored unless they are reciprocal.
I'm sorry, I don't completely understand what you mean here.
What are your thoughts on simply changing the UK/EU site from "gb-en" to "en"?
I will look at either finding a way to exclude Googlebot from my redirect or offering a popup to customers on which site they prefer to visit. Thank you for the advice here.
-
So, a few things in here to respond to:
On x-default, ideally you want this on both "sites", but it would be the same value. Meaning, you are telling Google that if a search visitor is in the US, serve the US page as a result, if the visitor is in the UK, serve the UK page as a result, and if that visitor is in any other location (one you don't have tags for) then serve the page linked in the x-default tag. So, on both sites, it would have the same value. Wherever you want to send the traffic from any country/language not specified in your hreflang tags.
On the EU tags, there's not a "penalty". There's just no "Europe" locale. Since you need to specify valid locales, the only way I know of to scope "Europe" is to include all the locales (or at least the most popular ones. I generally add the primary language for each country, a few languages for countries such as Belgium, and sometime I add en-[country] for all of them if my EU site is in English only.
Also on the EU tags, you should not remove the EU tags and only tag the US site. Tags will all be ignored unless they are reciprocal.
Lastly, on the redirect. There are several approaches. But if the Google bot tries to index your UK site from a server in the US, and gets auto-redirected, that's not a good thing. One approach is to make the auto-redirect "soft", meaning instead of automatically redirecting, present a dialog asking the visitor whether they want to visit the page they requested, or to instead be redirected to the one suggested for their geographic location. This is also a better user experience for several scenarios like when employees may be using a corporate VPN which is located in another country (like their international headquarters for example), or for when people live near country borders. Yes, you want to treat Google the same way as a person, which is why the "soft" redirect approach has become somewhat of a standard. There are other approaches, like having an international "splash" page, and also yet more approaches. I tend to favor the dialog approach.
-
Thank you for the response.
My system only allows me to add x-default to the US site, but I can code it into both if need be, is this necessary for both?
If Google penalises you for using GB then perhaps I should just use a generic EN? I think to try and add the other EU lang tags without an actual translate option could cause annoy Google, but if I do, it would look like this, correct?
Or would I write en-DE, en-IT, etc?
As for the redirect, I use an external service to do this automatically, and I thought it was best practice to treat Google exactly the same as you treat a customer?
-
While your tags above looks correct, I would also recommend to add "x-default" hreflang tags. This lets the search engines know which version of the page to include in results for search traffic outside of the ones specifically listed.
Related to this, I notice you referred to one of the sites as "Europe", but you only included an en-GB tag. Unfortunately, the specification for hreflang doesn't accommodate "Europe" (I wish it did). So, most of the time I generate hreflang tags for all the most common language/country combinations in Europe, all pointing to the one "Europe" page, when I'm dealing with sites which have a single site for all of Europe. This approach isn't pretty, but I haven't yet found a better one. Perhaps this might explain some of your drop, if now you are only targeting UK and US, whereas before you might have reached other parts of Europe and the world in general.
I would try adding x-default and the other European country/language combinations before just dropping the idea of hreflang tags.
Also, you may want to make sure both of these sites are accessible without redirection from all locations. Search engine bots may arrive from servers anywhere, so you want to make sure you don't auto-redirect them based on geo-ip.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Getting accurate Geo Location traffic stats in Google Analytics - HELP
One of our clients services the US and the UK, but having looked at the report over an extended period of time we can still see that the vast majority of traffic is coming from the US. I.e. our last report for March indicated that there were over 3,000 users in the US but only 6 in the UK. We know that Google Analytics works out a user’s location based on where their IP is located and not their physical location, and that this means that the data needs to be taken with a pinch of salt as it won’t always represent what you expect. That being said, we know that the traffic figures for Europe are largely inaccurate and would like to get some more accurate stats to report on. Is there a way to do so at all within Google Analytics?
International SEO | | Wagada1 -
Correct Hreflang & Canonical Tags for Multi-Regional Website English Language Only having URL Parameters
Dear friends, We have a multi-regional website in English language only having the country selector on the top of each page and it adds countrycode parameters on each url. Website is built in Magento 1.8 and having 1 store with multiple store views. There is no default store set in Magento as I discussed with developer. Content is same for all the countries and only currency is changed. In navigation there are urls without url parameters but when we change store from any page it add parameters in the url for same page hence there are total 7 URLs. 6 URLs for each page (with country parameters) and 1 master url (without parameters) and making content duplicity. We have implemented hreflang tags on each page with url parameters but for canonical we have implemented master page url as per navigation without url parameters Example on this page. I think this is correct for master page but we should use URL parameters in canonical tags for each counry url too and there should be only 1 canonical tag on each country page url. Currently all the country urls are having master page canoncial tag as per the example. Please correct me if I am wrong and **in this case what has to be done for master page? **as google is indexing the pages without parameters too. We are also using GEOIP redirection for each store with country IP detection and for rest of the countries which are not listed on the website we are redirecting to USA store. Earlier it was 301 but we changed it to 302. Hreflang tags are showing errors in SEMRush due to redirection but in GWT it's OK for some pages it's showing no return tags only. Should I use **x-default tags for hreflang and country selector only on home page like this or should I remove the redirection? **However some of the website like this using redirection but header check tool doesn't show the redirection for this and for our website it shows 302 redirection. Sorry for the long post but looking for your support, please.
International SEO | | spjain810 -
How should I handle hreflang tags if it's the same language in all targeting countries?
My company is creating an international version of our site at international.example.com. We are located in the US with our main site at www.example.com targeting US & Canada but offering slightly different products elsewhere internationally. Ideally, we would have hreflang tags for different versions in different languages, however, it's going to be an almost duplicate site besides a few different SKUs. All language and content on the site is going to be in English. Again, the only content changing is slightly different SKUs, they are almost identical sites. The subdomain is our only option right now. Should we implement hreflang tags even if both languages are English and only some of the content is different? Or will having just canonicals be fine? How should we handle this? Would it make sense to use hreflang this way and include it on both versions? I believe this would be signaling for US & Canda visitors to visit our main site and all other users go to the international site. Am I thinking this correctly or should we be doing this a different way?
International SEO | | tcope250 -
Is this setup of Hreflang xml sitemap correct?
Hi, I'm trying to setup hreflang for 2 domains. One is purely a US site and the other domain has the language-country as subdomains. For example: http://www.websiteUSA.com (Targets English - USA) https://www.websiteINT.com/en-CA (Targets English - Canada) https://www.websiteINT.com/fr-CA (Targets French - Canada) https://www.websiteINT/es (Targets Spanish) ..and so on and so forth for about 12 of these international URLs. I created an XML sitemap that looks something like this: <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>http://www.websiteUSA.com</loc></url></urlset> <url><loc>https://www.websiteINT.com/en-CA</loc></url> <url><loc>https://www.websiteINT.com/fr-CA</loc></url> Question 1: Is this correct? In my actual file, I have all the countries listed and self-referencing. Question 2: I'm hosting this file at https://www.websiteINT.com/hreflang.xml AND at http://www.websiteUSA.com/hreflang.xml. Is this correct? Question 3: Will this help the SERPs direct english speakers from the US to http://www.websiteUSA.com while show SERPs for say English Speakers in Canada to https://www.websiteINT.com/en-CA? Question 4: For some reason, when I put up the xml site, it only listed each URL once instead of the full XML file. Should I have uploaded a text file instead? It doesn't seem to render correctly. Thank you!
International SEO | | SylviaH0 -
Direct traffic is up 2100% (due to a bot/crawler I believe)
Hi, The direct traffic to website www.webgain.dk has increased by over 2100% recently. I can see that most of it is from US (my target audience is in Denmark and the website is in danish).
International SEO | | WebGain
What can I do about this? All this traffic gives my website a bounce rate of 99.91% for direct traffic. I believe it is some sort of bot/crawler. 2100percentboost.png0 -
Webmaster tools - a drop in Views and Searches
Hi everybody I'm experience a very odd thing in Webmaster Tools (and Google Analytics). 4. March I can se a drop of views from about 2000 views a day to 250 views a day and the days thereafter they views are close to zero. Also some of the search term looks weird after this and is terms like w www.youtube.com, youtube musicas and youtube i put a spell on you, placing them in SERP in top 10 and refering to our /Youtube site (which is a blank site with no content). 5. March we got some new content on our site regarding danish flyers, and even though Webmaster Tools shows that our views are close to zero, Google Analytics shows an increase of trafic to our site from search terms from about 150 visits 4. March to about 600 visits 16. March. So what Webmaster Tools shows about views do not make any sense to me and especially not why we would rank on the term Youtube. I have also searched on some of these Youtube search terms and I can't see us ranking in SERP on these terms in top 10, but in Google Analytics I can see that we have got visits on these Youtube search terms. The domain we are using is an old domain that hosted an e-mail and chat site and I am a bit worried about the external links to our site. But the external links that Webmaster Tools and Open Site Explorer shows I don't see as bad links and the site has not had anything to do with Youtube clips. Our site is a https site - I don't know if that could have anything to do with it? So I'm really puzled about why Webmaster tools says our Views have dropped to zero, why Google Analytics says there is an increase of trafic from search to our site and what Youtube search terms have to do with our site?
International SEO | | Bulpen0 -
International websites : hreflang
Hi, i'm looking for good examples with 'href lang' tag (rel="alternate" hreflang="x") Have you examples of websites with this tag? Thanks D.
International SEO | | android_lyon0 -
3 month old site lost almost complete traffic overnight
Hi All, I started a Indian coupon and deal site http://www.couponspy.in/ around 3 month ago and traffic increased almost daily. But yesterday my site lost almost all of its traffic. Keywords which ranked 1-5 lost around 4-15 places and keywords which ranked 6-20 lost ca. 20-50 places. The Moz Crawl Diagnostics doesn't indicate any mayor issues. Has there been a Google Panda update in India? Reasons why my site has been affected? Please help!!!! 😉 I have seen the same traffic decrease on other coupon start ups, eg https://www.cuponation.in/ and https://www.cuponation.in/ Did we all make the same mistake? Any guesses?
International SEO | | ParvatiSingh0