Can I add more than one XML sitemap in my Robots.txt File?
-
I have 3 domains all hosted on the same Magento Enterprise Platform. Each domain targets a different county.
.co.uk, .com.au, and .com.
Can I add all three sitemaps in my robots.txt file?
-
As an add-on, I would really suggest you to implement the rel="alternate" hreflang="x-X" tags in your sitemaps.xml in order to better your international SEO efforts and geotargeting.
Check this official post by Google
-
You can certainly add as many sitemaps to your robots.txt file as you want; however, the references in the sitemap should refer to the resources on the domain in question. For example, you won't want to include a sitemap reference on example.com's robots.txt that refers to URLs on example.co.uk.
If the sites have all the same pages, you can just include the same sitemap with relative URLs. You can also just add the correct sitemap to the correct domain in Google Webmaster Tools. Hope that helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is this setup of Hreflang xml sitemap correct?
Hi, I'm trying to setup hreflang for 2 domains. One is purely a US site and the other domain has the language-country as subdomains. For example: http://www.websiteUSA.com (Targets English - USA) https://www.websiteINT.com/en-CA (Targets English - Canada) https://www.websiteINT.com/fr-CA (Targets French - Canada) https://www.websiteINT/es (Targets Spanish) ..and so on and so forth for about 12 of these international URLs. I created an XML sitemap that looks something like this: <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>http://www.websiteUSA.com</loc></url></urlset> <url><loc>https://www.websiteINT.com/en-CA</loc></url> <url><loc>https://www.websiteINT.com/fr-CA</loc></url> Question 1: Is this correct? In my actual file, I have all the countries listed and self-referencing. Question 2: I'm hosting this file at https://www.websiteINT.com/hreflang.xml AND at http://www.websiteUSA.com/hreflang.xml. Is this correct? Question 3: Will this help the SERPs direct english speakers from the US to http://www.websiteUSA.com while show SERPs for say English Speakers in Canada to https://www.websiteINT.com/en-CA? Question 4: For some reason, when I put up the xml site, it only listed each URL once instead of the full XML file. Should I have uploaded a text file instead? It doesn't seem to render correctly. Thank you!
International SEO | | SylviaH0 -
Multilingual website - Url problem (sitemap)
At this moment our website both uses the language in the url like "en" and localizes the url itself ("books" in english and "boeken" in dutch). Because of the history of making our website multilingual we have a system that takes the browser language for the localization if the url doesn't contain a language like "en". This means: www.test.com/books = browser language www.test.com/en/books = english language www.test.com/boeken = browser language www.test.com/nl/boeken = dutch language Now for the sitemap this makes it a little troublesome for me because which hreflang is used for which url? 1) The first thing I thought of was using x-default for all urls that get the language of the browser. <code><url><loc>http://www.test.com/books</loc></url></code> But as you can see we now got 2 times x-default. 2) Another solution I thought of was just use the localization of the url to determine the language like: <code><url><loc>http://www.test.com/books</loc></url></code> But now we got 2 of each language for the same page. 3) The last solution I thought of was removing links without a language in the url (except for the homepage, which will still have an x-default) like: <code><url><loc>http://www.test.comen/books</loc></url></code> But for this solution I need to put 301's at pages that are "deleted" and also need to change the system to 301 to the right page. Although the last point isn't really a problem I'm kind of worried that I will lose some of the "seo points" with a 301. (When we changed our domain in the past we had a bad experience with the 301 of our old domain) What do you think would be the best solution for SEO? Or do you have any other suggestions or solutions I haven't thought of.
International SEO | | Anycoin0 -
Can multiple hreflang tags point to one URL? International SEO question
Moz, Hi Moz, Can multiple hreflang tags point to a single URL? For example, if I have a Canadian site (www.example.com/ca) that targets French and English speakers can I have the following: or would I use: Any insight would be very helpful and greatly appreciated! Thank you in advance!
International SEO | | DA20131 -
Multilingual Sitemap with some non-matching URLs
The website has two languages, English (.com/en-int/) and French (.com/fr-fr/). Some pages only exist in French, and some only in English, but there are many that are a 1-to-1 match. So, my questions is, in the multilingual sitemap, should I only include the URLs that are alternates, and then create a 2nd sitemap for all non-matching URLs? Or should I have 3 sitemaps: 1) Multilingual sitemap for all matching URLs (https://support.google.com/webmasters/answer/26208650 , 2) English sitemap for only URLs not included in multilingual sitemap, 3) French sitemap for only URLs not included in multilingual sitemap. And then create a sitemap index file to link to all 3 sitemaps.
International SEO | | Alex.Weintraub0 -
301 juice from my old website to the new one?
Hi there! I am the proud webmaster of two websites, my old one: bioenergeticaconvicen.wordpress.com, currently with decent rankings in Google Spain (as bioenergeticaconvicen.com without the www, if i am not mistaken) on keywords like "Bioenergetica", "bioenergetica barcelona" "formacion en bioenergetica" "bioenergetica transpersonal" -You got the idea. 🙂 and my new one, "www.biomayeutika.org" , wordpress as well, with somehow decent rankings on "centro de bioenergetica" "bioenergetica" etc. It's a health an spiritual business: we dance, breath and mainly just feel our bodies without trying to control anything that happens. Cool 🙂 It's a very local business, aiming mostly for people from Barcelona/Catalonia but also for people from the rest of Spain. a) I guess my main question is just how to pass the old "SEO juice" to the new website. Currently, there's just a link on the old one pointing to the new one. b) Will I somehow merge the rankings of the two? c) How do i do a 301? which pages? With a wordpress plugin? Thanks very much in advance for your help. P.D.: Secondarily, I am open to suggestions on how to improve my SEO strategy (currently, none :)) I am very active in Facebook and have a few good videos and pictures, but I haven't really tried to do good SEO.
International SEO | | roybatti0 -
Do we need to update our sitemaps each time our content changes?
Dear SEO experts! We have created sites maps to get our international sub-domains indexed, however we're unsure if we have to update our sitemaps each time our content changes on our many landing pages which are translated to 17 different languages? Obviously the goal is to make it dynamic so it updates itself. I hope you can help us with some advice. Thanks a lot! Allan
International SEO | | Todoist0 -
Google adwords keyword tool - Can anyone recommend a free service that is similar?
Hi everyone, As many of you know the Google keyword tool is going away unless you have an active campaign. Can anyone recommend a tool that is similar and free? We do international SEO so it is really important for me to get keyword suggestions in several languages. Thanks Carla
International SEO | | Carla_Dawson0 -
Global SEO - How quickly/aggressively should one expand into multiple countries?
SITUATION: Our client is a global company lacking the global presence, so naturally the idea is performing international/global SEO in each country. For benchmarking purposes, our plan is to focus on a select number of keywords (ie 8-15) for each country and begin link building within each respective country. All SEO effort (ie. link building) will be for sub-folders (ie. www.client.com/subfolder/) on the same top level domain. Note, each country may have multiple languages, so each language will be broken out as it's own unique SEO campaign with it's very own strategy and link building efforts. For example: Mexico has 2 languages (English & Spanish) and will be considered 2 separate campaigns. PROBLEM: The client wants to be extremely aggressive and perform SEO on 3 new countries every month. This amounts to 36 new countries/SEO campaigns per year. Assuming each country has 2 languages each, we are looking at 6 SEO campaigns per month, or 72 per year. Our concern is that since all SEO effort will be performed on the same top level domain, we may be growing too fast and the search engines may consider the addition of these new pages and links to be too 'spammy'. We'd love to hear some feedback or personal experience on what might be considered a "safe" or "healthy" expansion into different countries. Thanks!
International SEO | | ByteLaunch0