Is a site map necessary or recommended?
-
We have a website that has been up for the past 4 years without a site map.
Google is indexing it. Do we need a site map? Do you recommend we create one and submit it to goggle and bing?
The site is www.logobids.com
Thank you.
-
Hi Mike,
Thanks for the tip. I checked and our .xml sitemap has 55 pages and Google is indexing 53. not sure what the 2 missing pages are or how to find out, but I imagine the difference may have to do with blog archives or something along those lines. At any rate, I'm reassured by this. Thanks again.
Gina
-
Hi Gina,
If you use Google Webmaster Tools you can see how many pages you submitted on your sitemap and how many Google has indexed under Optimization > Sitemaps.
It will also list if you have an issues with your xml sitemap.
Hope this helps.
Mike
-
I would say that the sitemap is not needed per say, however, it is good practice to have one, whether it be for client navigation around a site or to assist Google with the root navigation of the website.
From the earlier days in my SEO career I was taught to always incorporate a few standard items as basic procedure as they once you are used to the routine you cannot do any harm if even Google no longer needs then, these were things like sitemap.html, sitemap.xml and robot.txt.
It seems like Google is no longer taking a sitemap for the same purpose as it used to as the technology is advancing, so it now seems like personal preference.
A little bit like the old:
"Which should you do first, On-page SEO or Off-page SEO?" debate.
Hope this helps.
-
It's not needed per se, but then if you have a large website and you think about the user and you want them to be easily able to find sections of your website, it can't hurt to have a HTML sitemap.
As for XML sitemap, the only reason I consider doing them to make sure if there are any issues of indexability, I know. So that I can act on that information and do something. Otherwise for a large scale website with over hundreds and thousands of pages, how'd you know if you have a section of your site not indexed for whatever reasons ?
-
This is a strong indicator something is up and deserves deeper investigation.
Perhaps you have content duplication issues, low value content (Panda), spammy back links (Penguin) or other indexing issue. See if there is a pattern to the missing pages, perhaps one of the directories is the cause. How old is the site and how is the domain trust/authority coming along?
-
I'm jumping in here with an offshoot question for Mike. (or anyone else with an idea)
You suggest "If you Google site:logobids.com you can see which of your pages Google has indexed."
I just tried that and only 10 out of 40+ pages on our site are coming up. We have both an html site map and an xml site map on our site. There isn't any noindex code on the site other than for blog comments.
Any idea why Google isn't showing them all?
Thanks!!
-
A stale or poorly created sitemap can hurt in the following ways:
- long lived 404 pages - deleted pages continue to be indexed if not removed from the sitemap
- use up Google indexing allowance - if 404 and low value pages are included, Googlebot will use up valuable indexing allowance on them vs covering more of your important content.
- links to private areas - depending on how the map is created, the tool may not be smart enough to not include administration or community pages that you don't want in the index.
- inclusion of noindex pages - a couple methods (such as a robot.txt update after a sitemap is created) will include noindex pages which a technical problem. I'm not 100% sure of the impact but I could see this being a quality indicator.
- create distracting work - maintaining sitemaps, particularly semi-manual ones from Xenu etc., suck time better spent improving your indexability or earning back links.
However, all of these are easily avoidable with a solid approach and/or good server side tools.
-
Thank you for the responses. It seems like it is something that cant hurt the site or the indexing. The sacrifice is my time, other than that it has nothing but upsides and no downside.
I think we will go forward with creating the site map and submitting to Google.
-
I don't have a site map on any of my sites. Never any problem getting indexed or ranking. None.
-
I may get chastised for this but I believe the value of sitemaps is over stated.
All things being equal, I feel they are crutches and band-aids for poor webdesign/production.
Your site should:
- be easily indexed by all engines
- expose all pages with in four-five links of the home page(s)
- utilize thoughtful linking to promote important content in an organic manner
- expose new content on a high value, frequently indexed page (ie the home page) long enough to be found
- be consistent enough that the site will seem similar after one or two passes by Googlebot.
I like sitemaps when big structural changes occur as the sites heal faster. They're good when a lots of pages are only exposed via a long pagination scheme. I also use them to break down parts of a site to expose problem areas (IE when a sitemap has 50 links but Google only indexes 25 of them)
But, they can be detrimental if they are not maintained properly. If anything changes in the structure, it should be immediately reflected in the sitemap. Lots of automated ones don't consider the robot.txt file which can cause problems.
For SEOs, adding a sitemap is an easy way to ensure everything is at least looked at without having to touch the actual site.
Advice: yes, use them but only if you can use them properly or can't fix current indexing issues. Over the long haul however, you should force yourself to think of it as not there.
-
A sitemap is like a map with driving directions for Google. Sure they can probably find their way through your site, but with a map they can get through more efficiently and make sure to look at all of your pages.
It is not required for a site to get indexed.
If you entire site is indexed, you don't "need" a sitemap; however, it is good practice to have one.
Say you add a new page and want it to get indexed quickly by Google, you would just update your sitemap and submit it to Google. It alerts them you have made changes and to reindex your site.
If you Google site:logobids.com you can see which of your pages Google has indexed.
Hope this helps.
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does no-follow for pages affect site ranking?
Hey, I have a question. On my site, it's divided into the main site and the blog is in a subfolder of same domain. Within the main site (same domain), there are MANY checkout pages and other internal pages we use though all with "NO FOLLOW" on each. Despite it having "NO FOLLOW", will it affect our blog rankings in any way or domain ranking?"
On-Page Optimization | | Mirian0 -
Is a mobile domain necessary?
Greetings all, I'm starting to build a mobile version of our website to be ready for April 21st. Question is: is it absolutely necessary to have a mobile domain name or can I just direct users to same domain/folder? in other words: www.mywebsite.com/mobile vs m.mywebsite.com - does this even matter? As always, thank you!
On-Page Optimization | | md30 -
Problem with getting a site to rank at all
We pushed this Word Press site live about a month ago www.primedraftarchitecture.com. Since then we've been adding regular content, blog posts 3 times a week with social posts on facebook, twitter, G+ and LinkedIn. We also submitted via Moz Local about 3 weeks ago. Yext about two weeks ago and have been adding about 5 listings to small local directories a week. Webmaster tools shows that the site map is valid and the pages of the site are getting indexed and it shows links from 7 sites, mostly directories. I'm just not seeing the site ranking for anything. We're getting zero organic traffic. I though we did a good job not over optimizing the pages. I'm just stymied trying to figure out what's wrong. Usually we push a site live and see at least some low rankings after just a couple of weeks. Can anyone see anything that looks bad or where we've gone wrong?
On-Page Optimization | | DonaldS0 -
On page/site - Images & bold text
As I understand it on a page where you are going for the keywords 'Metal gates', you have an image titled 'Metal gates' (Lets say MG for Metal gates to save on my typing!) with the alt tag being 'MG' Now as I also understand it, if an image is also used as a link the Alt tag is also the anchor text? So, I have a page on Metal gates using the above methods, from this page I have image links to a metal driveway gates page (as well as text links), would I be best using an image titled 'Metal driveway gates' with the alt text as ' Metal driveway gates' to link to my metal driveway gates page (if you follow me)? Also on the image question, what if you have say six images (that are all links) on the metal gates page, how would you title the images and alt tags? Variations on Metal gates? Or using the keyword on the page that the link points to? (I'm not looking to keyword stuff but want to get it right! ) Also is it important to have your on page keywords in bold still? i ask because I've bolded text on my pages but not the main keywords - I've bolded text that I want people to see, but do not want to take away any power from my keywords if you follow me?
On-Page Optimization | | Jon-C0 -
Implementation of Rich Text Snippets on a e-commerce site
Hey Guys I'm working on the implementation of Rich Text Snippets , I have basically 3 types of page Product Page Category Page Homepage On the product page I'm going to implement the product scheme which seem relatively straight forward , I'm struggling a bit understand what can be implement on the homepage & category page if anything For the Homepage I was planning to use the organisation scheme http://schema.org/Organization using the object thing my question is can you use the image tag to try and get google to display our brand logo ? just like the author & recipe etc.. we sell branded goods so on each ideally for branded page we provide brand description and brand logo http://brokenscene.com/uk/brands/famous-stars-and-straps.html can you use any snippets or is it best to focus on just the products ? Ben
On-Page Optimization | | elbeno0 -
Directory site with an URL structure dilemma
Hello, We run a site, which lists local businesses and tag them by their nature of business (similar to Yelp). Our problem is, that our category and sub-category(i.e.: www.example.com/budapest/restaurant or www.example.com/budapest/cars/spare-parts) pages are extremely weak, and get almost no traffic, but most of the traffic (95+ percent) goes for the actual business pages. While this might be a completely normal thing, I still would like to strengthen our category (listing) pages as well, as these should be the ones targeted by some of general keywords, like ‘restaurant’ or ‘restaurant+budapest’. One of the issues I have identified as a possible problem, that we do not have a clear hierarchy within the site, so while the main category pages are linked from the homepage (and the sub-categories from here), there is no bottom-up linking from the business pages back to the category pages, as the business page URLs look like this: www.example.com/business/onyx-restaurant-budapest. I think, that the good site- and url structure for the above would be like this: www.example.com/budapest/restaurant/hungarian/onyx-restaurant. My only issue is, perhaps not with the restaurants but with others, that some of the businesses have multiple tags, so they can be tagged i.e. as car saloon, auto repair and spare parts at the same time. Sometimes, they even have 5+ tags on them. My idea is, that I will try to identify a primary tag for all the businesses (we maintain 99 percent of them right now), and the rest of their tags would be secondary ones. I would then use canonicalization and mark the page with the primary tag in the url as the preferred one for that specific content. With this scenario, I might have several URLs with the same content (complete duplicates), but they would point to one page only as the preferred one, while our visitors could still reach the businesses in any preferred ways, so either by looking for car saloons, auto-repair or spare parts. This way, we could also have breadcrumbs on all the pages, which now we miss completely. Can this be a feasible scenario? Might it have a side-effect? Any hints on how to do it a better way? Many thanks, Andras
On-Page Optimization | | Dilbak0 -
How is my on-site SEO looking like?
I know this is a broad question. My site's content has been written more than one year ago and haven't been changed so far. Our main goal is to make the application hosted in the site work better every day, so we don't worry much about writing content. The URL is http://www.onlinelogomaker.com
On-Page Optimization | | rpedri0 -
How Can I Get Yahoo to Index My Site?
How Can I Get Yahoo to Index My Site? I have installed Bing webmaster tool two months ago -- is Yahoo that slow. My site has been out since May 2010 and for a year and a half, I only have 40 pages index. HELP!!!!
On-Page Optimization | | AppleCapitalGroup0