What is the best method for segmenting HTML sitemaps?
-
Sitemaps create a Table of Contents for web crawlers and users alike. Understanding how PageRank is passed, HTML sitemaps play a critical role in how Googlebot and other crawlers spider and catalog content.
I get asked this question a lot and, in most cases, it's easy to categorize sitemaps and create 2-3 category-based maps that can be linked to from the global footer. However, what do you do when a client has 40 categories with 200+ pages of content under each category? How do you segment your HTML sitemap in a case like this?
-
You might benefit form a visualization program as well like Visio, Mindjet, or Mindmiester to figure out some of the more intricate details. Also JoelHit's suggestion of using Apple.com as an example is a good one. Even though their main sitemap is smaller than what you're describing there are some subtle takeaways when looking at it as an example (http://www.apple.com/sitemap/).
- All their top level categories are H2 tagged major categories of their site.
a. "Apple Info" emphasizes the brand
b. Mac, iPod, iPhone, iPad all emphasize product sales
c. iTunes, Downloads, Support emphasize sales and an ongoing customer relationship. - Precedence is given to the core aspects of their business via their sitemap.
a. As outlined above, this is elegant and functional.
Also, you'll certainly want to back up the work you do with an HTML sitemap with XML sitemaps for large scale sites and as Richard suggested register them all with Google Webmaster.
- All their top level categories are H2 tagged major categories of their site.
-
With HTML or XML sitemaps you can link from one to another.
sitemap = Main sitemap [I would put the main sitemap on all upper level site pages (root, contact us, etc.]
sitemap-cat-01 which then links to all other sitemaps for that category [category sitemap on that category's page]
Then register the individual sitemaps with Google Webmaster.
I think I said that correctly, but it is way past my bedtime lol
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What would the Impact of having a sitemap be?
Hi, some more general question here: How important would you rate it to have a sitemap? Would you rate it fundamentally important or just something you can add as bonus? Thanks in advance
Intermediate & Advanced SEO | | brainfruit0 -
To include in Sitemap or not to include?
Hello all, A bit of a confusing one but please bear with me... On our website we have a Used Cars section where each morning a feed is loaded onto our site with any changes to the stock. Some cars may have been sold and removed, some new cars may be added, some prices may be changed, every day every morning this very large section of our website is updated. The question I have is, should I be including these urls in my sitemap? The Used Cars section is a huge portion of our website content and is our most important area, the Used Cars overview is our most frequently visited page. The reason I ask is because of course Google might crawl and see car X, but tomorrow car X could be gone and be replaced with car Y. Should I be even mentioning these pages to Google if by tomorrow some of those urls could be gone? It's always changing and it's something we don't have control of. Thanks!
Intermediate & Advanced SEO | | HB170 -
Max Amout Of HTML Pages In A Folder
What's the maximum amount of html pages that one should put in a folder, to get the best SEO GoggleBot crawl? I'm aware that there's a limit of 10,000 on most servers, but was curious to know if a lesser amount of pages would be better, for crawling and indexing purposes. Also curious on peoples opinions on whether .jpg and .gif files should follow similiar rules.
Intermediate & Advanced SEO | | alrockn0 -
What is the best way to track rank?
I'm curious what tools and tracking mechanisms everyone uses to track rank, especially with all of the changes in the last year. I've read a ton of articles that say even in 2014, rank will continue to matter, but besides using the keyword rank tool in Moz, I was hoping to learn what everyone else uses to track rank on a keyword and page level (are those two separate things?).
Intermediate & Advanced SEO | | RachelEm0 -
Changing domains - best process to use?
I am about to move my Thailand-focused travel website into a new, broader Asia-focused travel website. The Thailand site has had a sad history with Google (algorithmic, not penalties) so I don't want that history to carry over into the new site. At the same time though, I want to capture the traffic that Google is sending me right now and I would like my search positions on Bing and Yahoo to carry through if possible. Is there a way to make all that happen? At the moment I have migrated all the posts over to the new domain but I have it blocked to search engines. I am about to start redirecting post for post using meta-refresh redirects with a no-follow for safety. But at the point where I open the new site up to indexing, should I at the same time block the old site from being indexed to prevent duplicate content penalties? Also, is there a method I can use to selectively 301 redirect posts only if the referrer is Bing or Yahoo, but not Google, before the meta-refresh fires? Or alternatively, a way to meta-refresh redirect if the referrer is Google but 301 redirect otherwise? Or is there a way to "noindex, nofollow" the redirect only if the referrer is Google? Is there a danger of being penalised for doing any of these things? Late Edit: It occurs to me that if my penalties are algorithmic (e.g. due to bad backlinks), does 301 redirection even carry that issue through to the new website? Or is it left behind on the old site?
Intermediate & Advanced SEO | | Gavin.Atkinson0 -
Best Approach to Get Backlinks for this site
Hello, What would be a good approach to gain backlinks for this site: www.nlpca.com The owners don't have much time to write content. I as the consultant have time but do not have the expertise the owners do. The people that run the site are authorities in the field. Thanks!
Intermediate & Advanced SEO | | BobGW0 -
Canonical Meta Tag Best Practices
I've noticed that some website owners use canonical tags even when there may be no duplicate issues.For examplewww.examplesite.com has a canonical tag.......rel="canonical" href="http://www.examplesite.com/" />www.examplesite.com/bluewidget has a canonical tag.......rel="canonical" href="http://www.examplesite.com/bluewidget/" />Is this recommended or helpful to do this?
Intermediate & Advanced SEO | | webestate0 -
Taking out a .html plugin
We are currently working on a new site structure and we would like to take out a WP plugin that adds a .html to the end of every URL. From my understanding it is best to not use this plug in. Once I take out this plug in will I need to do anything for all the external links to count. Will the link juice pass through? if you type my url now without the .html in your browser it adds it in the .html. However, all the external links we built have the .html in the URL link. Do I need to do any 301 or canonical to pass link juice or will I be fine after taking out the plug in?
Intermediate & Advanced SEO | | SEODinosaur0