Non US site pages indexed in US Google search
-
Hi,
We are having a global site wide issue with non US site pages being indexed by Google and served up in US search results. Conversley, we have US en pages showing in the Japan Google search results.
We currently us IP detect to direct users to the correct regional site but it isn't effective if the users are entering through an incorrect regional page. At the top of each or our pages we have a drop down menu to allow users to manually select their preferred region. Is it possible that Google Bot is crawling these links and indexing these other regional pages as US and not detecting it due to our URL structure?
Below are examples of two of our URLs for reference - one from Canada, the other from the US
/ca/en/prod4130078/2500058/catalog50008/
/us/en/prod4130078/2500058/catalog20038/
If that is, in fact, what is happening, would setting the links within the drop down to 'no follow' address the problem?
Thank you.
Angie
-
John,
Thanks for adding all of these great suggestions - I don't do international that often so the full list of methods isn't always in my conscious awareness!
-
Here's all the things you can do to try geotarget your content for the search bots:
- Register each subfolder as a separate site in Google Webmaster Tools (e.g. example.com/ca/, example.com/us/), and geotarget it (see here).
- Set meta tags or http headers on each page to let Bing know the language and country (see here).
- For duplicate or near-duplicate pages across different English speaking localities, you can try out the hreflang tags to clue Google in that they're the same page, but geotargeting users in different locations. I haven't personally implemented this myself, so I can't speak to how well it works, but you can find more info about it hereand here.
Setting nofollows just stops PageRank from flowing, but bots can still follow these links, so I wouldn't do that.
-
Its absolutely possible that's what's happening. You cannot rely on Google's system being barred from crawling anything on your site, no matter how well you code it. Even if you blocked the URL with nofollow, it would not stop the bot.
Another factor is if all your content is in English (as your URL structure suggests it is). Google does a terrible job of discerning separation of international content when all the content is in the same language, on the same root domain.
Proper separation in a way Google can't confuse is vital. Since I expect you do not intend to change the language across sites, your best action would be to migrate international content to a completely different domain. At the very least you can then use GWT to inform Google that "this domain is for this country", however if you want to be even better off, you'd host that other content on a server in that country.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Setting up international site subdirectories in GSC as separate properties for better geotargeting?
My client has an international website with a subdirectory structure for each country and language version - eg. /en-US. At present, there is a single property set up for the domain in Google Search Console but there are currently various geotargeting issues I’m trying to correct with hreflang tags. My question is, is it still recommended practise and helpful to add each international subdirectory to Google Search Console as an individual property to help with correct language and region tagging? I know there used to be properly sets for this but haven’t found any up to date guidance on whether setting up all the different versions as their own properties might help with targeting. Many thanks in advance!
International SEO | | MMcCalden0 -
Is it compulsory to use hreflang attribute for Multilingual site? What if I do not use such tag?
Hello Everybody, My main site - abcd.co.uk and other sites are like this se.abcd.co.uk, fr.abcd.co.uk, es.abcd.co.uk etc Now if I donot use hreflang for Multilingual site then google will consider it as subdomain or duplicate site? But content of the sites are in different language. Thanks!
International SEO | | wright3350 -
Human Translation versus Google Translate for Ecommerce Products
Hi all, We want to put our products on our ecommerce site into another language. I have always been under the impression that running text through Google Translate is a no no, not only for the user experience, but also it is a Google tool and I am assuming that Google would notice that it is not translated by a human. I don't know if it would incur a penalty as such but it most likely would not be favoured as a human translation Can anyone confirm their experience or impression on this? Thanks!
International SEO | | bjs20100 -
Specific page URL in a multi-language environment
I've read a lot of great posts on this forum about how to go about deciding the best URL structure for each language that your site will support, so thank you to everyone that has provided input on that. I now have a question that I haven't really found answers/opinions on. When providing a page translation, should my content URL reflect that of the country I'm targeting or always remain the same across all sites? Below is an example using the "About Us" page. www.example.com/about-us/
International SEO | | Matchbox
www.example.com/es-mx/about-us/ -- OR -- www.example.com/about-us
www.example.com/es-mx/sobre-nosotros Thank you in advance for your help. Cheers!0 -
How does Google Serve the correct language version?
Hi guys, I'm currently working on a multi lingual .eu website with 20 lanuages which has been live now for a month now. Its is a sub directory set up so the french language version would look something like www.example.eu/fr. The English language version defaults to the home page www.example.eu. When you search for the brand name on the local search engines the home page English version appears instead of the preferred language version for each Country. 90% of the external links so far link to the homepage so I'm guessing this is the reason why. We are still waiting for the development company to create sitemap for each language using the rel=”alternate” hreflang=”x” XML Sitemap Tool. I know Google look at a number of factors when deciding what results to give a user. Can anybody share their experience or advice here? Thanks Rob
International SEO | | daracreative0 -
Multi-National Website Demarcation in Organic Search
We launched our business in the UK many years ago using a .com domain and have built up good link equity back to our www site. Last year, we launched the same business in the US and host the US site on a "us." sub domain. We have used Google Webmaster Tools to demarcate the two websites so that the www site is set to target the UK and the "us." sub domain is set to target the US. Our organic search results from Google UK for the UK business are fine but when our US customers Google brand terms the www UK site takes precedence in organic search. To complicate this further, the sitelinks within the search results include a mixture of pages from the www UK site and the "us." US site. Google clearly has some difficulty understanding that the two sites are for two different geographic audiences. We have a good relationship with Google and they have indicated (with appropriate disclaimers) that we might consider aligning the URL structures for both sites to reduce the precedence that the www site currently receives. The www home page will become an International portal and the UK and US URL structures will be aligned. We have two options: Change both sites to subdomains so that we have "uk.xxxxx.com" and "us.xxxxx.com" linked to an International portal at the www subdomain Use sub folders so that we have "www.xxxxx.com/uk/" and "www.xxxxx.com/us/" again linked from the www subdomain We're comfortable with use of 301 redirects and canonicals to change the structure in a search engine friendly way but cannot agree internally whether sub domains or sub folders is the way to go. Unfortunately we're to far down the line to seperate by tld. Anyone have a strong opinion on the best approach? Thanks, Jeremy
International SEO | | www.webuyanycar.com0 -
Lightbox on Home Page for Geo-Targeting
Hi -- I have a client with various international versions of their site. By adding a lightbox to their U.S. home page enabling the user to select their preferred translation (and cookie them)....does this have any negative SEO implications? It seems like a better alternative than the splash page they were using, but just want to be sure. Thanks!
International SEO | | MedThinkCommunications0 -
Search engine usage stats
Hi I'm looking to find the number of people who use different search engine sin different countries aspart of some research into an International SEO project. I've searched Google all afternoon but can't find what i'm looking for so hopefully someone here can help What i'm looking for is the number of users of different Google versions in UK and Ireland, so: google.com v google.ie in Ireland and google.com v google.co.uk in UK Thanks for your help Jason
International SEO | | robotseo0