Can I add more than one XML sitemap in my Robots.txt File?
-
I have 3 domains all hosted on the same Magento Enterprise Platform. Each domain targets a different county.
.co.uk, .com.au, and .com.
Can I add all three sitemaps in my robots.txt file?
-
As an add-on, I would really suggest you to implement the rel="alternate" hreflang="x-X" tags in your sitemaps.xml in order to better your international SEO efforts and geotargeting.
Check this official post by Google
-
You can certainly add as many sitemaps to your robots.txt file as you want; however, the references in the sitemap should refer to the resources on the domain in question. For example, you won't want to include a sitemap reference on example.com's robots.txt that refers to URLs on example.co.uk.
If the sites have all the same pages, you can just include the same sitemap with relative URLs. You can also just add the correct sitemap to the correct domain in Google Webmaster Tools. Hope that helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can a Global Website Rely on Browser Settings for Translation?
Our website serves a global market and over a year ago, we launched 8 language variations of the site and implemented hreflang tags. These language variation pages are proving difficult to maintain, and in Search Console they're triggering thousands of errors. I have double checked our implementation and it's not perfect, so I understand the errors. Here's the question though... the 8 language variations of the site are receiving less than 1% of our web traffic despite 40% of our web traffic coming from countries outside of North America every month. I want to know if we can eliminate the headache of these 8 language variations altogether, remove our attempt at hreflang, and simply rely on the browser settings of the user to dictate what language the website appears in for them? If not, is there a simpler solution than hreflang and attempting to maintain a very large website in 8 languages? Thank for your input! Niki
International SEO | | NikelleClark0 -
Has any one seen negative SEO effects from using Google Translate API
We have a site currently in development that is using the Google Translate API and I am having a massive issue getting screaming frog to crawl and all of our non-native English speaking employees have read through the translated copy in their native language and the general consensus is it reads at a 5th grade level at best. My questions to the community is, has anyone implemented this API on a site and has it a) helped with gaining traffic from other languages/countires and b) has it hurt there site from an SEO standpoint.
International SEO | | VERBInteractive0 -
DMoz, can I submit 3 top level domains?
Hi Guys, I have 3 top level domains, does anyone know if it is okay to submit all 3 domains? they all cover different countries, NZ, AUS, USA - The NZ one has been submitted, but our main site is the .com (USA) after running a few adwords campaign we decided to work the .com instead! Does anyone know the terms or guidelines around this?
International SEO | | edward-may0 -
Do we need to update our sitemaps each time our content changes?
Dear SEO experts! We have created sites maps to get our international sub-domains indexed, however we're unsure if we have to update our sitemaps each time our content changes on our many landing pages which are translated to 17 different languages? Obviously the goal is to make it dynamic so it updates itself. I hope you can help us with some advice. Thanks a lot! Allan
International SEO | | Todoist0 -
Multiple Regional Domains - such as .co.uk / .de etc for one brand
Hello, We are in the process of building up our version 2 for our site, currently we have only one domain (i.e. xxxxx.com). Our target audience is distributed among various regions and speak different languages, we would like to know which will benefit us more: a) by having one root domain and then having folders based on automatic IP detection, for example the customer opening a website in Japan would see the domain as: www.xxxx.com/jp. B) or is it better to have different domains so in the above case it will be www.xxxx.co.jp. The content on the site will be different based on the regional demand, so of course the language will be Japanese and the content will also be aligned with the Japanese community. We plan to start with 5 different markets (UK/US/AU, Japan, China, Germany, Spanish speaking countries). We would appreciate if you can suggest us the best route to achieve the best results. Thank you, SK
International SEO | | sidkumar0 -
Google adwords keyword tool - Can anyone recommend a free service that is similar?
Hi everyone, As many of you know the Google keyword tool is going away unless you have an active campaign. Can anyone recommend a tool that is similar and free? We do international SEO so it is really important for me to get keyword suggestions in several languages. Thanks Carla
International SEO | | Carla_Dawson0 -
Using Javascript to alter ONE or TWO keywords in International Site
Hi, What is the best way to target a language that has slight variations in it without actually targetting specific countries? Scenario: Ecommerce site that sells mobile phones in Spanish, initially created to target Spanish from Spain. We call a mobile phone a "movil" Now we want to target LatinAmerican users, which also use Spanish with variations, the most notable being mobile phone called "celular". We don't want to create specific sites via new ccTLDs, nor subdomains, no directories for each new country, and we want to avoid having two sites - one for spain, one for latinamerica- given that the only major difference is we say MOVIL in spain and CELULAR in LatinAmerica. What is Googles take if we simply decide to modify THAT specific keyword in each page where it is mentioned? Either by: a) Server based. IP Detect. that is, render the page with either one or the other term b) Javascript based. i.e. Have BOTH terms on all pages but using Javascript show/hide according to user preferences. c) Display the keywords with different font sizes/emphasis, depending on the visitor. Any ideas?
International SEO | | doctorSIM0 -
Robots.txt issue with indexation
Hello i have a problem with one of the rules for robots.txt i have a multilingual mutation of entire page on www.example.com/en/ I want to make indexable /allow/ the main page under /en/ but not indexable /disallow/ everything else under /en/* Please help me how to write the rule.
International SEO | | profesia0