XML SiteMap - Right Away or Delay?
-
So, I have a new client whose web designer declined to create an XML site map. They said that they would rather wait a year and let Google create one.
I am wondering what the opinion of other SEOMoz members is about this--do you create an XML right away or think there is an advantage in delaying?
Personally, I always prefer to have one right away--What is the best practice in your experience and why?
-
I hate when I reply and it doesn't post!
Thanks Ryan,
Appreciate your sharing your experience in submission before posts are made. I would not have thought about doing one for subdomains--great insight and suggestion.
The site in question has been up a while and is pretty comprehensive so I thought it would be a good practice. Another site I am working on did not have one either and it will be interesting to see how the XML sitemap added today will impact it.
Thanks again to all of you for chiming in. Very helpful, I just had not heard of someone declining to create one as a general practice before.
-
Todd, I appreciate your suggestion about the video site map. That is a great idea that I did not think of!
So, I must confess that I've been remiss about using Webmaster Tools but as my sophistication has increased, I am expanding my use of other tools for a more comprehensive approach.
-
Thanks Martijn,
I've mainly been an SEO writer until this last year or so and almost exclusively work on small business websites.
I take an initial look at the indexing of the pages on Yahoo, Google and Bing and then monitor it over time. Since I do a lot of work for web designers, my preference for XML sitemaps is just one of practice.
It seems that many small business sites do not include them and I like to work to get them an edge in many different ways. Many have horrible sites that need all the help they can get!
-
Martijn and Todd share some good points. I'll add a different viewpoint. If your site offers solid navigation and no island pages, sitemaps are completely unnecessary.
When you register your site, Google will begin attempting to crawl the main page of the site. If you offer standard, crawlable navigation, then Google will find every page on your site naturally. Sitemaps offer Google and Bing a list of links to your site's pages. If a link is noticed in your sitemap which has not been otherwise crawled, then your sitemap offers an opportunity for search engines to crawl the page.
As for timing, just be sure there is actual content on your site prior to submitting a sitemap. I had once installed forum software on a site and then submitted a sitemap to Google prior to any posts being made. I received a penalty notice and had to submit a reconsideration request to have the site later indexed.
There are only a few cases where I can see the benefit of submitting a sitemap. A couple examples:
-
if you add a new sub-domain which is otherwise not linked to by your main site
-
if you add an island page to your site which you wish to be indexed
-
-
Hola!
google has this to say about submitting sitemaps "Submit a Sitemap to tell Google about pages on your site we might not otherwise discover." ala Webmaster tools. I stand firmly behind your inkling to create a good standard issue sitemap and submit. Last week we had a client (attorney) who did not have a sitemap at all for the three years her site was up, google had about 22 pages in its index, after sitemap, 432 pages in its index. Be sure to submit to BIng webmaster tools as well, cover all bases!
so I say create right away, its not going to hurt anything, and can quite honestly help a lot! as a footnote to this answer, if you are using videos, etc... on the site be sure to build a video sitemap as well we have been seeing a lot successful indexing of our clients media.
Hope this helps!
-
For our company/websites we used different methods of submitting our sitemaps, but until now I prefer submitting the XML sitemaps after a couple of weeks/months (it varies with the kind of website). For us this had a couple of reasons, these were the main ones:
- Insights in your ("natural") crawl stats: By waiting a couple of weeks/months with submitting your sitemaps to Google we were able to see the "natural" crawl stats of our websites.
- Analyse the differences: This also applies to the reason I mentioned above. If you wait you are able to see the difference in your crawl stats after submitting your sitemap to Google. You are not definitely sure if this is directly correlated to you submitting your sitemap of course. But at least you could have a look.
But there are sure also reasons for directly submitting a sitemap: you are directly able to segment your urls, so you can see which segments of your website need to be optimized. And the number of pages crawled vs indexed.
I would like to know your own answer to the question. Why do you prefer submitting a XML sitemap right away?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website redesign- change of server . What to do with old site? Keep for a while or delete right away?
Hey Mozzers, Two days ago, we redesigned our website and changed the server at the same time to get faster loading times. Here is what we have done. The old site was hosted on ipage, new site with a new design hosted on UPCLOUD. We changed the A record to the new server, uploaded a new site, submitted a new sitemap to Google Search console, 301 redirected all old URLs to new ones, most have changed a bit. Old URLs were ending with " .html "the new ones do not have that at the end. Submitted AMP pages to Google as well. Now here is my question. Should we delete the old site completely from ipage or should we keep it for a while? Google has indexed the new URLs that were created with the redesign, these URLs did not exist on the old site. But it still shows most of the old URLs on SERPs (these are URLs that have been 301 redirected to a new equivalent page) I understand 2 days is not very long for Google to get everything right, but I am not sure what we should do with the old site? Keep it or get rid of it to help Google index the new one only. FYI every single old URL that appears on Google search when clicked on will take you to the right place, we made sure there are no 404s at all. As this is very important to our business and we get most of it from Google I want to make sure we do it right for SEO purposes. The agency that designed the site did not really know the answer to that question, as they do not have SEO specialists. Please help, any input you might have will be greatly appreciated.
Web Design | | Davit19850 -
Sitemap and Privacy Policy marked for duplicate content?
On a recent crawl, Moz flagged a page of our site for duplicate content. However, the pages listed are our sitemap and our privacy policy -- both very different: http://elearning.smp.org/sitemap/ http://elearning.smp.org/privacy-policy/ What is our best option to address this issue? I had considered a noindex tag on the privacy policy page, but since we have enabled user insights in Google Analytics we need to have the privacy policy displayed and I worry that putting a noindex on the page would cause problems later.
Web Design | | calliek0 -
Tips on finding the right Senior Designer / Design Director
Hello Everyone, I manage a fairly large educational website that we are looking to completely redesign to improve the overall site user experience and usability. In the past I, a non-designer, business person, would just roughly draw how I thought the site should look and our developer (who is good, but not a web designer) would just try his best to make everything look profession. Over the years, it has become painfully obvious that we need to invest in more design expertise and move towards a modern, smartly designed website. So my question: Where are the best places to find good freelance designers? I have of course conducted web searches, browsed elance, and asked my network for referrals. However, I am finding that most of the really good ones, ones who have to ability to take charge and lead us through this entire process, and who have at least a basic understanding of SEO principles, work for larger integrated development shops who also expect their people to develop the new site as well. We already have a developer and are primarily looking for the design expertise. Does anyone in the Moz community have any suggestions or even referrals? Thanks! Eric
Web Design | | Eric_R0 -
Site structure and Visual Sitemaps
Aside from mind mapping software are there any tools ( recommended) to build a visual sitemap of the internal linking structure of a URL? I've been trying to 'show' clients the structure of a website as it pertains to internal and external links. Here is one I've tried it's "Close" - http://site-visualizer.com/ . I've been using the excel export function, import into mind meister and building it. It's a teeny bit time consuming for large websites. Site structure I feel is a valuable portion of SEO and a down and dirty visual explanation would be great. Don't get me wrong, it offers other benefits as well- it's just I'd like to free up the time it takes. Thank you in advance. Screen shots are available on the website of the organization.
Web Design | | TammyWood0 -
Sitemap Question - Very Old Ecommerce Site, Never Used A Map
I help manage a family website, that has about 10,000 products... It was top ranked since 1996, then got smacked by Penguin and recovered but its still receiving only a fraction of the natural traffic it used to get. Something we have never used... Is a sitemap. I'm curious if anyone knows reliable software that will generate a sitemap? My cart is custom built, website uses html pages across the board. Dynamic content and parameters are set up properly, onsite seo is in the excellent range. The only thing that I haven't been utilizing is a sitemap. Because the cart was hand built, it would a huge convenience to use a lightweight program thats compatible with any website, has parameter settings, exclusions and anything else useful to negate any duplicate content. I have a few highly dynamic pages as well... If anyone knows a product or a possible solution, it would be much appreciated. Working it up myself would be very time consuming. Thx
Web Design | | Southbay_Carnivorous_Plants0 -
Nav / Sitemap Question. Using a "services" page vs just linking directly to individual service page?
Okay, so our company offers video production, web design, and web marketing services. While we do offer these services individually, our goal is to get our clients to integrate these services together. Our nav is currently like so : home - about - video - web design - web marketing - blog - contact Now I've seen businesses and agencies also use a nav with a "services" button instead of listing out their service offerings (if they have more than 1, like us). The services button usually links to a category page or has a drop down with links to the company's individual services. I'm wondering if there is any benefit to having a main services page like this and linking to the individual pages off of it (video ,web design, marketing, etc). Or if we should just keep it the way we have it now (since we've already got some page authority on the individual service pages). I know this may not be the most important aspect of our site and we may be over-thinking it but any thoughts/ideas would be greatly appreciated, thanks!
Web Design | | RenderPerfect0 -
Am I on the right track -- still not seeing results in rank, traffic, etc.
I am a complete novice, but I tend to learn quickly. My site is one year old, and I have very low traffic. I also rank poorly. I have recently learned a ton, and made some changes: 1. Put in meta no follow, no index tags on certain pages 2. Found and fixed some horrid content -- I had forgotten to finish certain pages (!) and they had been left up for months -- a good example is /California-homeschool.html basically said "Washington homeschool, blah, blah, blah" for about 8 months before I fixed it (!) 3. Added new content, changed the look and navigation of the site, added social media links and have been working to build those up (FB, Twitter, etc) 4. Started blogging regularly. Those are the main things I have done. I plan to continue to add content, tweak the navigation, and blog regularly. From what I can tell, link building should happen organically. My question is: Am I on the right track? Here is a link to my site: http://www.i-school-at-home.com Am I missing anything -- there seems to be so much info out there. Because there is a time lag between making changes and seeing results, I just would love to know if I am on the right track, before I devote more time to this strategy. What I would like to do is be the #1 homeschool website (long term goal) and generate revenue (eventually) from affiliate marketing and creating my own curriculum and resources. Thank you!!!!!!
Web Design | | WendyKKelly0 -
Mobile Sitemap for Site with Media Queries
I'm doing SEO for a site. It uses Media Queries and the CSS to automatically resize the site for the screen size in use. I.e. the site detects the screen size of say an iPhone and the CSS knows which elements to hide for that screen size and still make it look good. This is great because it will automatically cut down the content to display nicely on small screens - obviating the need for a separate mobile site. What kind of sitemap should be generated since the urls are for desktop and mobile use? Yoast (sweet SEO) said it should have both regular and mobile style sitemap to get both the regular and mobile bots to visit, but didn't elaborate on how that sitemap should look. Do you have a recommendation for how exactly the sitemap should look? Should the sitemap have the urls all twice, i.e. once regular and once with the mobile indicator?
Web Design | | GregoryHaze1