XML SiteMap - Right Away or Delay?
-
So, I have a new client whose web designer declined to create an XML site map. They said that they would rather wait a year and let Google create one.
I am wondering what the opinion of other SEOMoz members is about this--do you create an XML right away or think there is an advantage in delaying?
Personally, I always prefer to have one right away--What is the best practice in your experience and why?
-
I hate when I reply and it doesn't post!
Thanks Ryan,
Appreciate your sharing your experience in submission before posts are made. I would not have thought about doing one for subdomains--great insight and suggestion.
The site in question has been up a while and is pretty comprehensive so I thought it would be a good practice. Another site I am working on did not have one either and it will be interesting to see how the XML sitemap added today will impact it.
Thanks again to all of you for chiming in. Very helpful, I just had not heard of someone declining to create one as a general practice before.
-
Todd, I appreciate your suggestion about the video site map. That is a great idea that I did not think of!
So, I must confess that I've been remiss about using Webmaster Tools but as my sophistication has increased, I am expanding my use of other tools for a more comprehensive approach.
-
Thanks Martijn,
I've mainly been an SEO writer until this last year or so and almost exclusively work on small business websites.
I take an initial look at the indexing of the pages on Yahoo, Google and Bing and then monitor it over time. Since I do a lot of work for web designers, my preference for XML sitemaps is just one of practice.
It seems that many small business sites do not include them and I like to work to get them an edge in many different ways. Many have horrible sites that need all the help they can get!
-
Martijn and Todd share some good points. I'll add a different viewpoint. If your site offers solid navigation and no island pages, sitemaps are completely unnecessary.
When you register your site, Google will begin attempting to crawl the main page of the site. If you offer standard, crawlable navigation, then Google will find every page on your site naturally. Sitemaps offer Google and Bing a list of links to your site's pages. If a link is noticed in your sitemap which has not been otherwise crawled, then your sitemap offers an opportunity for search engines to crawl the page.
As for timing, just be sure there is actual content on your site prior to submitting a sitemap. I had once installed forum software on a site and then submitted a sitemap to Google prior to any posts being made. I received a penalty notice and had to submit a reconsideration request to have the site later indexed.
There are only a few cases where I can see the benefit of submitting a sitemap. A couple examples:
-
if you add a new sub-domain which is otherwise not linked to by your main site
-
if you add an island page to your site which you wish to be indexed
-
-
Hola!
google has this to say about submitting sitemaps "Submit a Sitemap to tell Google about pages on your site we might not otherwise discover." ala Webmaster tools. I stand firmly behind your inkling to create a good standard issue sitemap and submit. Last week we had a client (attorney) who did not have a sitemap at all for the three years her site was up, google had about 22 pages in its index, after sitemap, 432 pages in its index. Be sure to submit to BIng webmaster tools as well, cover all bases!
so I say create right away, its not going to hurt anything, and can quite honestly help a lot! as a footnote to this answer, if you are using videos, etc... on the site be sure to build a video sitemap as well we have been seeing a lot successful indexing of our clients media.
Hope this helps!
-
For our company/websites we used different methods of submitting our sitemaps, but until now I prefer submitting the XML sitemaps after a couple of weeks/months (it varies with the kind of website). For us this had a couple of reasons, these were the main ones:
- Insights in your ("natural") crawl stats: By waiting a couple of weeks/months with submitting your sitemaps to Google we were able to see the "natural" crawl stats of our websites.
- Analyse the differences: This also applies to the reason I mentioned above. If you wait you are able to see the difference in your crawl stats after submitting your sitemap to Google. You are not definitely sure if this is directly correlated to you submitting your sitemap of course. But at least you could have a look.
But there are sure also reasons for directly submitting a sitemap: you are directly able to segment your urls, so you can see which segments of your website need to be optimized. And the number of pages crawled vs indexed.
I would like to know your own answer to the question. Why do you prefer submitting a XML sitemap right away?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website redesign- change of server . What to do with old site? Keep for a while or delete right away?
Hey Mozzers, Two days ago, we redesigned our website and changed the server at the same time to get faster loading times. Here is what we have done. The old site was hosted on ipage, new site with a new design hosted on UPCLOUD. We changed the A record to the new server, uploaded a new site, submitted a new sitemap to Google Search console, 301 redirected all old URLs to new ones, most have changed a bit. Old URLs were ending with " .html "the new ones do not have that at the end. Submitted AMP pages to Google as well. Now here is my question. Should we delete the old site completely from ipage or should we keep it for a while? Google has indexed the new URLs that were created with the redesign, these URLs did not exist on the old site. But it still shows most of the old URLs on SERPs (these are URLs that have been 301 redirected to a new equivalent page) I understand 2 days is not very long for Google to get everything right, but I am not sure what we should do with the old site? Keep it or get rid of it to help Google index the new one only. FYI every single old URL that appears on Google search when clicked on will take you to the right place, we made sure there are no 404s at all. As this is very important to our business and we get most of it from Google I want to make sure we do it right for SEO purposes. The agency that designed the site did not really know the answer to that question, as they do not have SEO specialists. Please help, any input you might have will be greatly appreciated.
Web Design | | Davit19850 -
Is the User Sitemap dead?
There's a discussion going on in our office about sitemaps. I thought it'd be a good idea to get the thoughts of the Moz community in on it, too. What are your thoughts? is the User Sitemap still an effective tool to utilize?
Web Design | | TaylorRHawkins1 -
Sitemap Update Frequency?
Hello, My question today is regarding sitemaps. I'm often confused by this and because I am a bit obsessive I believe I may be giving myself more work than needed.. Basically my question is, do I need to update and/or re-generate my sitemap every time I make a change to the site? I mean, I must have to if I add a page, correct? And so in Google's Webmaster Tools, do I just delete the current sitemap and re-upload a new one for Google to crawl? Is it possible to overdo this? Any sitemap suggestions would be fantastic. I feel like there's been a few weeks where I've updated the sitemap daily and re-submitted it and I worry that might be hurting my site. Thanks!
Web Design | | jesse-landry0 -
Nav / Sitemap Question. Using a "services" page vs just linking directly to individual service page?
Okay, so our company offers video production, web design, and web marketing services. While we do offer these services individually, our goal is to get our clients to integrate these services together. Our nav is currently like so : home - about - video - web design - web marketing - blog - contact Now I've seen businesses and agencies also use a nav with a "services" button instead of listing out their service offerings (if they have more than 1, like us). The services button usually links to a category page or has a drop down with links to the company's individual services. I'm wondering if there is any benefit to having a main services page like this and linking to the individual pages off of it (video ,web design, marketing, etc). Or if we should just keep it the way we have it now (since we've already got some page authority on the individual service pages). I know this may not be the most important aspect of our site and we may be over-thinking it but any thoughts/ideas would be greatly appreciated, thanks!
Web Design | | RenderPerfect0 -
Schema.org - Right way to mark the pages
Dear all, Almost since we started designing our site, we are using schema microdata. It is not only because of the rich snippets, but because I want the search engines to better understand what we have. For example, the +1 buttom would not work properly without schema microdata, because it kind of ignores the OpenGraph parameters that specified image and description; and since we are a (very small) local bussiness directory (between other things), all our clients have a hand written schema complient description on their lisings, including address, opening ours, telephone number, description, etc. It is hand written by us because the tools avialable are simply not good enough to cover all different scenarios that a listing can present. I have not use, until today, a proper for the homepage, and it is probably the cause that our page lost the nice links below the site description in the google snippet. I did not place it on the body tag, but near the description, closing it inmediately after the description finishs. Now this is solved and we will wait to see if the links come back in the next weeks. Now to the question. Our site has three sections, with three different systems installed, two running wordpress and a third running another script. the main site is the local bussiness directory. The front page is mark as "schema.org/WepPage", and I do not know how to mark the other pages of the main site. I was thinking of marking the listings as "schema.org/ItemPage" since they are related to specific clients. Would you consired it to be right? Then, we have landing pages for the categories, should they be mark as WepPage, or as an Article, or something else? Many thanks in advance for your help, Best Regards, Daniel
Web Design | | te_c0 -
Unable to submit sitemap in GWM.. Error
I recently published new EMD and installed WP on their. Now i installed the Plugin called Yoast <acronym title="Search Engine Optimization">SEO</acronym> and XML Sitemap. Now whenever i am trying to submit sitemap it shows "URL restricted by robots.txt" but you can see my robots file line written below: User-agent: *
Web Design | | xplodeguru
Disallow: /cgi-bin/
Disallow: /wp-admin/ But still it is showing same error.. i deactivate plugin and resubmit the sitemap but still no luck.. please help0 -
Why is there no sitemap.xml for SEOmoz?
I noticed that SEOmoz does not have a "root" sitemap called sitemap.xml. On the other hand, there do appear to be sitemaps for various sections of the such as http://www.seomoz.org/blog-sitemap.xml I was planning on having a root level sitemap that referenced difference sections of my site (blog, support, etc.) but I'm a little concerned that this site itself doesn't seem to be following that practice. Presumably this website is submitting the individual section maps to Google directly since they aren't linkable through sitemap.xml?
Web Design | | schof0 -
Site Re-Design - Running old XML site map for 301's
Hi all, We are going to launch a new site design for our current e-commerce site. I have taken this opportunity to change some categories due to keyword research and all old categories will be 301ed to best fitting new category. So I have 2 questions about moving stuff over; 1. I read that leaving the old xml site map running for the first week, would help, because this would give crawlers the chance to run through the site and follow the 301s, which would help pass the juice. How true does this sound? 2. I was thinking of re-writing all category and sub category titles, meta descriptions and on page content. The positive of this is loads of fresh content - but doing this all at the same time with the new site launch might see some major dropping in search ranking. I've identified our top traffic keyword terms/pages, would it be more wise to leave these pages, and change the others, or would the total new fresh burst have a better impact? Cheers
Web Design | | ToxicFox0