Is a site map necessary or recommended?
-
We have a website that has been up for the past 4 years without a site map.
Google is indexing it. Do we need a site map? Do you recommend we create one and submit it to goggle and bing?
The site is www.logobids.com
Thank you.
-
Hi Mike,
Thanks for the tip. I checked and our .xml sitemap has 55 pages and Google is indexing 53. not sure what the 2 missing pages are or how to find out, but I imagine the difference may have to do with blog archives or something along those lines. At any rate, I'm reassured by this. Thanks again.
Gina
-
Hi Gina,
If you use Google Webmaster Tools you can see how many pages you submitted on your sitemap and how many Google has indexed under Optimization > Sitemaps.
It will also list if you have an issues with your xml sitemap.
Hope this helps.
Mike
-
I would say that the sitemap is not needed per say, however, it is good practice to have one, whether it be for client navigation around a site or to assist Google with the root navigation of the website.
From the earlier days in my SEO career I was taught to always incorporate a few standard items as basic procedure as they once you are used to the routine you cannot do any harm if even Google no longer needs then, these were things like sitemap.html, sitemap.xml and robot.txt.
It seems like Google is no longer taking a sitemap for the same purpose as it used to as the technology is advancing, so it now seems like personal preference.
A little bit like the old:
"Which should you do first, On-page SEO or Off-page SEO?" debate.
Hope this helps.
-
It's not needed per se, but then if you have a large website and you think about the user and you want them to be easily able to find sections of your website, it can't hurt to have a HTML sitemap.
As for XML sitemap, the only reason I consider doing them to make sure if there are any issues of indexability, I know. So that I can act on that information and do something. Otherwise for a large scale website with over hundreds and thousands of pages, how'd you know if you have a section of your site not indexed for whatever reasons ?
-
This is a strong indicator something is up and deserves deeper investigation.
Perhaps you have content duplication issues, low value content (Panda), spammy back links (Penguin) or other indexing issue. See if there is a pattern to the missing pages, perhaps one of the directories is the cause. How old is the site and how is the domain trust/authority coming along?
-
I'm jumping in here with an offshoot question for Mike. (or anyone else with an idea)
You suggest "If you Google site:logobids.com you can see which of your pages Google has indexed."
I just tried that and only 10 out of 40+ pages on our site are coming up. We have both an html site map and an xml site map on our site. There isn't any noindex code on the site other than for blog comments.
Any idea why Google isn't showing them all?
Thanks!!
-
A stale or poorly created sitemap can hurt in the following ways:
- long lived 404 pages - deleted pages continue to be indexed if not removed from the sitemap
- use up Google indexing allowance - if 404 and low value pages are included, Googlebot will use up valuable indexing allowance on them vs covering more of your important content.
- links to private areas - depending on how the map is created, the tool may not be smart enough to not include administration or community pages that you don't want in the index.
- inclusion of noindex pages - a couple methods (such as a robot.txt update after a sitemap is created) will include noindex pages which a technical problem. I'm not 100% sure of the impact but I could see this being a quality indicator.
- create distracting work - maintaining sitemaps, particularly semi-manual ones from Xenu etc., suck time better spent improving your indexability or earning back links.
However, all of these are easily avoidable with a solid approach and/or good server side tools.
-
Thank you for the responses. It seems like it is something that cant hurt the site or the indexing. The sacrifice is my time, other than that it has nothing but upsides and no downside.
I think we will go forward with creating the site map and submitting to Google.
-
I don't have a site map on any of my sites. Never any problem getting indexed or ranking. None.
-
I may get chastised for this but I believe the value of sitemaps is over stated.
All things being equal, I feel they are crutches and band-aids for poor webdesign/production.
Your site should:
- be easily indexed by all engines
- expose all pages with in four-five links of the home page(s)
- utilize thoughtful linking to promote important content in an organic manner
- expose new content on a high value, frequently indexed page (ie the home page) long enough to be found
- be consistent enough that the site will seem similar after one or two passes by Googlebot.
I like sitemaps when big structural changes occur as the sites heal faster. They're good when a lots of pages are only exposed via a long pagination scheme. I also use them to break down parts of a site to expose problem areas (IE when a sitemap has 50 links but Google only indexes 25 of them)
But, they can be detrimental if they are not maintained properly. If anything changes in the structure, it should be immediately reflected in the sitemap. Lots of automated ones don't consider the robot.txt file which can cause problems.
For SEOs, adding a sitemap is an easy way to ensure everything is at least looked at without having to touch the actual site.
Advice: yes, use them but only if you can use them properly or can't fix current indexing issues. Over the long haul however, you should force yourself to think of it as not there.
-
A sitemap is like a map with driving directions for Google. Sure they can probably find their way through your site, but with a map they can get through more efficiently and make sure to look at all of your pages.
It is not required for a site to get indexed.
If you entire site is indexed, you don't "need" a sitemap; however, it is good practice to have one.
Say you add a new page and want it to get indexed quickly by Google, you would just update your sitemap and submit it to Google. It alerts them you have made changes and to reindex your site.
If you Google site:logobids.com you can see which of your pages Google has indexed.
Hope this helps.
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site Wide Links
Howdy Moz! So our agency has been around for long enough to have a few sites we've built that have our credit in their footer resulting in a site wide link. Mostly just our name. We've heard that Google does not particularly like site wide links, should we go through and remove some of these old links?
On-Page Optimization | | wearehappymedia0 -
SEO for a site in development
We've recently taken on a new client for an initial 6 months for SEO (until their new site is going live) to help build traffic to the site. They are currently getting a new website built so don't want work done on their current site... but due to the current structure it is making it difficult for us to improve rankings for a number of keywords. They are essentially a booking engine for services across the UK so it is just a home page with a search filtering through their services, locations and dates which leads to a results page. It is a combination of services and locations we need to target keywords for but there are no appropriate landing pages due to the site layout. The one thing they are happy for us to work on is the blog, so my question is would it be best to create landing pages on the blog targeting keywords such as 'sports massages in London' and build links to these pages? Then when it is time for the new site, with new appropriate landing pages, simply 301 redirect these pages? If anyone has any input on this idea or suggestions for other ways about it we'd be delighted to hear from you Thanks
On-Page Optimization | | Will_Craig0 -
Should I use nofollow when interlinking large, networked sites?
My company runs a network of very large networked sites, each with thousands of content pages. In our main navigation we are currently not nofollowing links between these networked sites. The links appear on every single page in the top navigation, and there are thousands of pages on each site. I am worried this will look to Google like we have suspiciously received thousands of links from one domain - one link from every page on the domain. Should we be nofollowing these navigation links between the different sites in our network?
On-Page Optimization | | Natasha90040 -
Website redesign: site going from .php to .html
A site I'm working on is being redesigned because the current platform does not allow for content to be changed easily. In the process, they are going from .php to .html. I am concerned about their losing link juice. Can a site work with the old content remaining .php and the new content being .html or should all pages stay .php?
On-Page Optimization | | cakelady0 -
Site Downtime - Will pages be reindexed?
I recently had site downtime of about 10 days for a site I'm working on which is about 6 months old. There were naturally many page not found errors in webmaster tools as google had tried to crawl the site during the downtime but I've noticed that google has now dropped some of the pages. Are they likely to be reindexed? Google has crawled some of my pages today but as yet the ones that have been dropped from the index haven't reappeared. (the site has been live again for a week). Should they reappear when the pages are next crawled?
On-Page Optimization | | SamCUK0 -
Site Wide Link
I have just run up the link explorer on my site and discovered that every page home page link points back with the text home - I assume this is bad in terms of SEO , my site name is ccie and I assumed that it put the site wide link of ccie to the entire site, however it seems to be the breadcrumb default of home which is doing it/. www.rogerperkin.co.uk/ccie Should I be looking to change this so my top keyword points back from each page to the home page. I am running wordpress and assumed the site name was the home link on all pages. Can anyone advise the best practice? Thanks
On-Page Optimization | | rogerp0070 -
Moving a site as a folder of existing one
We have the following case: Site A with domain authority 65 and 2,750 linking root domains (139K total links) and Site B with domain authority 68 and 1,336 linking root domains (38K total links) There's a suggestion to move Site A as a folder of Site B so it becomes something like this: domainB.com/domainA using 301 redirects for the existing domain A. We'd like to better understand what such move will result in. I imagine at first Site A will drop in rankings, but after that will it be better for it to be under Site B domain? Also, moving all the pages a step behind in the URL path may slightly affect their rankings. What do you think? Would you move Site A or leave it as a separate domain? I understand there can't be an exact estimation what will happen, but I'll appreciate your thoughts.
On-Page Optimization | | lgrozeva0 -
Anchor Texts on Internal Links on my Site Question
[Hey folks, Anchor text question for internal links on my site. We all know that proper anchor text is important for rankings, both in links pointing to your site and links on your site. Google webmaster tools is showing my top internal anchor text links to be letters. This is because of navigation on the site which is in a global footer on hundreds of thousands of pages. Do you think that this dilutes or minimizes the relevance of the real anchor texts that we are targeting which trail behind these, or if this went away it would have no effect on the rest of the anchor texts on the site. How would you handle this, we can just get rid of this navigation because it's passing PR and helping the pages get spidered. Thanks in advance. Anchor text 1. g 2. q 3. d 4. v 5. k 6. t 7. o 8. u 9. a 10. p 11. m 12. r 13. e 14. x 15. y 16. l 17. i 18. z 19. c 20. j 21. s 22. b 23. f 24. h 25. w 26. n](mailto:acaldarea@hotmail.com)
On-Page Optimization | | irvingw0