International Sites - Sitemaps, Robots & Geolocating in WMT
-
Hi Guys,
I have a site that has now been launched in the US having originally just been UK. In order to accommodate this, the website has been set-up using directories for each country. Example:
As the site was originally set-up for UK, the sitemap, robots file & Webmaster Tools account were added to the main domain. Example:
The question is does this now need changing to make it specific for each country. Example:
The sitemap and robots.txt for the UK would move to:
and the US would have its own separate sitemap and robots.txt. Example :
Also in order to Geolocate this in WMT would this need to be done for each directory version instead of the main domain? Currently the WMT account for the UK site is verified at www.domain.com, would this need reverifying at domain.com/en-gb?
Any help would be appreciated! Thanks!
-
Thanks for the insights. Very helpful. What about the robots.txt, though? Should it stay under http://www.example.com, where crawlers can find the file?
-
Yes, that's how I did it.
-
Thanks for the response, much appreciated.
Would this mean that the sitemap featured at www.domain.com would need to reference each directory version (UK & US etc etc), leaving the en-gb & en-us to reference just their own?
-
Hi, here's what Google officially has to say:
Webmaster Tools data and reporting work best on a site level. For example, if your site http://www.example.com has separate sections for different countries, we recommend adding each of those subsites or subfolders as a separate site. For example, if you have a travel site with specific subfolders covering Ireland, France, and Spain, you could add the following sites to your Webmaster Tools account:
- http://www.example.com
- http://www.example.com/france
- http://www.example.com/ireland
- http://www.example.com/spain
Following this I have solved the exactly the same problem you had for a client. And it works perfectly.
- _The question is does this ["sitemap"] now need changing to make it specific for each country. _What I have done is add the sitemaps for each subdirectory as well as the main domain. It works (tracking and all that) and is easy to do.
- _Also in order to Geolocate this in WMT would this need to be done for each directory version instead of the main domain? _Yes, that is the way to go.
- _Currently the WMT account for the UK site is verified at www.domain.com, would this need reverifying at domain.com/en-gb? _Yes, it does. And so do every other subdirectory you add down the line. That allows precise international targeting per subdirectory via the hreflang and country targeting settings and setting the main GWT site for the root domain to be for global traffic.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Setting up international site subdirectories in GSC as separate properties for better geotargeting?
My client has an international website with a subdirectory structure for each country and language version - eg. /en-US. At present, there is a single property set up for the domain in Google Search Console but there are currently various geotargeting issues I’m trying to correct with hreflang tags. My question is, is it still recommended practise and helpful to add each international subdirectory to Google Search Console as an individual property to help with correct language and region tagging? I know there used to be properly sets for this but haven’t found any up to date guidance on whether setting up all the different versions as their own properties might help with targeting. Many thanks in advance!
International SEO | | MMcCalden0 -
How to handle different content on same domain internationally?
Dear community, I have encountered a unique situation and I am unsure as how to proceed, I have a U.S. based website for intentions of this question is www.musicstore.com. The customer has decided to offer their products up for sale internationally, however, has two business requirements, one is that his international presence differs with product offering and content then the domestic version and two, that they both live on the same domain of www.musicstore.com without any reference to offering a differing international presence. Many of his products are offered for purchase directly overseas, while not against his suppliers rules, it is frowned upon. All this said, now to my question. I'm currently running a Magento two website install. With GeoIP setting which version of www.musicstore.com is presented. Do I have to worry about different content being displayed on the same exact url even though the experience is completely location based? If it is a concern, any risks I should be concerned with. I could possibly do something along the lines of www.musicstore.com/in/ while this is not ideal for the customer, if it prevents many larger issues I'd steer the customer this way. I just want my customer to be able to sell his product internationally without upsetting his suppliers or making Google go, what does this site actually have. Hopefully I explained my question well enough for those who can help to understand. Please ask if you need any more information. Any help would be greatly appreciated, thank you.
International SEO | | swarming0 -
IP Address Geolocation SEO - Multiple A records, implications?
Hi, We operate an ecom site, with a .com TLD. The IP address of the hosting is based in France and indeed we seem to see quite a lot of traffic from France. How relevant is the A record of the domain for SEO? Is it still an important signal to help Google geolocate? And, if that is the case, is there a case for having multiple A records for the domain? Like an IP Address in France, an IP address in Italy, etc... that way the domain would have multiple A records... Thank you
International SEO | | bjs20100 -
Why would a site lose rankings in U.S while maintaining rankings in other English locations (Canada & Australia)
What would cause a site to lose ranking in the U.S while maintaining top (1st page) positions in other English results countries such as Canada or Australia? Is this purely penguin related because of location of backlinks or are there other significant factors that could be in play? Would this rule out Panda as a cause because it's simply an "English language" targeted algo and not location dependent like backlinks (penguin)? Appreciate any insights
International SEO | | ResumeGenius0 -
Subdomains or subfolders for language specific sites?
We're launching an .org.hk site with English and Traditional Chinese variants. As the local population speaks both languages we would prefer not to have separate domains and are deciding between subdomains and subfolders. We're aware of the reasons behind generally preferring folders, but many people, including moz.com, suggest preferring subfolders to subdomains with the notable exception of language-specific sites. Does this mean subdomains should be preferred for language specific sites, or just that they are okay? I can't find any rationale to this other than administrative simplification (e.g. easier to set up different analytics / hosting), which in our case is not an issue. Can anyone point me in the right direction?
International SEO | | SOS_Children0 -
Using Javascript to alter ONE or TWO keywords in International Site
Hi, What is the best way to target a language that has slight variations in it without actually targetting specific countries? Scenario: Ecommerce site that sells mobile phones in Spanish, initially created to target Spanish from Spain. We call a mobile phone a "movil" Now we want to target LatinAmerican users, which also use Spanish with variations, the most notable being mobile phone called "celular". We don't want to create specific sites via new ccTLDs, nor subdomains, no directories for each new country, and we want to avoid having two sites - one for spain, one for latinamerica- given that the only major difference is we say MOVIL in spain and CELULAR in LatinAmerica. What is Googles take if we simply decide to modify THAT specific keyword in each page where it is mentioned? Either by: a) Server based. IP Detect. that is, render the page with either one or the other term b) Javascript based. i.e. Have BOTH terms on all pages but using Javascript show/hide according to user preferences. c) Display the keywords with different font sizes/emphasis, depending on the visitor. Any ideas?
International SEO | | doctorSIM0 -
How do I successfully verify my site for Baidu's webmaster tools?
Instructions for verifying a website via file validation for Baidu's webmaster tools are pretty vague. Does anyone know if the process is the same as Google Webmaster Tools where the verification string must appear in the URL and in the content of the file? Also, does it truly have to be verified within 2.6 hours? Appreciate any feedback from people who have successfully verified their site.
International SEO | | sigmaaldrich0 -
International SEO whats best 2 sites co.uk and com.au ?
We have the co.uk and com.au ccTLDS and currently operate out of the UK only but plans are in place for Australia. We can't get hold of the .org or .com so it has to be the ccTLD. I want to use the same site for both countries and either host 2 identical sites (same content) or 1 site with different domain names + meta tags for the 2 countries. Whats the best way to make this happen without screwing things up?
International SEO | | therealmarkhall0