XML Sitemaps for Message Boards / Forums - Best Practices?
-
I'm working with a message board that has been around for 10+ years and never taken SEO best practices into consideration. They recently started seeing mobile URLs show up in regular results, which they don't want. I'm recommending they implement multiple sitemaps to properly indicate to Google how to crawl the site and what to index. I've never dealt with a site this large so I'm not sure best practices. They have a HUGE community and new URLs are created every second. Doing a site: search returns "About 12,100,000" URLs. What are some best practices / the best way to approach sitemaps for a site of this size?
-
-
Very Helpful.
-
A lot depends on what the mobile forum is - a separate url or just a css change? Read this
In the end, you need to tell Google what version of the site to serve to regular visitors and which to serve to mobile users.
If it's such a big forum, the crawlers are probably constantly on the site anyways so sitemaps would do you less good than optimizing the actual forum.
However, if you are inclined to create a sitemap, consider making a sitemap index and splitting up the threads/sections/replies into separate sitemaps (at your discretion). The goal being that each sitemap is updated as often as the next the crawler can keep up with it (so if sitemap gets checked 3 times a day, make sure all the links that need to be crawled would probably appear during those 3 checks)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Sitemap Query
I've decided to write my own sitemap because frankly, the automated ones pull all kinds of out of I don't know where. So to get around that, manual it is. But I have some products appear in various categories, should I still list every product in each category in the sitemap, regardless of some being duplicates, or should I choose the most relevant category and list them there? I do have a canonical URL extension which should resolve any duplicate content I have.
Intermediate & Advanced SEO | | moon-boots0 -
Robots.txt - blocking JavaScript and CSS, best practice for Magento
Hi Mozzers, I'm looking for some feedback regarding best practices for setting up Robots.txt file in Magento. I'm concerned we are blocking bots from crawling essential information for page rank. My main concern comes with blocking JavaScript and CSS, are you supposed to block JavaScript and CSS or not? You can view our robots.txt file here Thanks, Blake
Intermediate & Advanced SEO | | LeapOfBelief0 -
Is it worth putting images in your sitemap?
I am always trying to optimize our website and have came across adding images to the sitemap. Has anyone done this? Did it make a big difference?
Intermediate & Advanced SEO | | EcommerceSite0 -
SEO Best Practice for a multi-language and multi-country website
Hello Moz Community, I hope someone could help me identify the best action to take on an on-page optimization confusion I am currently having. The website I am currently trying to optimize is http://www.riafinancial.com/locations/us/home.aspx. There is an option to view a country specific version of the page, or language version (there are 2 drop down menus on the top, for country or for language). When viewing a country specific version of the page, the URL changes depending on country selected. Some country versions also updates the content to the language of that country, but some remain English. Example, when viewing the France version of the page (http://www.riafinancial.com/locations/FR/home.aspx), the content is updated to french version, but when viewing the China version (http://www.riafinancial.com/locations/CN/home.aspx), the content is in English. This is because we have not yet translated for all countries (this will eventually be all translated). Now, when viewing by language, the URL does NOT change. Example, in http://www.riafinancial.com/locations/us/home.aspx, you can choose French, German, Italian, Polish, etc. The content of the page will change based on language chosen, but the URL (including page titles, meta-descriptions) will not change. My question is, how should I approach this for on-page optimization? Canonical? Hreflang? Any input, feedback, recommendation, suggestion will be greatly appreciated. Thanks! Sharon
Intermediate & Advanced SEO | | RiaMT0 -
What is the best way to learn SEO?
I was wondering if it's worth taking an SEO Training course. If so is it better to take a live class or Online class. Or is better to just read all the SEO Books out there? Or is there a good video series anyone can recommend? What is the best way to learn SEO? I have a good understanding of SEO but I'm not a Pro ( Yet ). Obviously SEO is always evolving so even the Pro's are constantly updating their skill set but I want to make sure my foundation is solid and complete. Advice Please. Thank you all.
Intermediate & Advanced SEO | | bronxpad0 -
What are best practices for multi-language seo?
We are looking for best practices for multi-language seo. We are interested in any books, message boards or blogs that you can recommend. Thanks.
Intermediate & Advanced SEO | | FareCompare0 -
Best SEO META Description for forum topics
What would be the best SEO META Description tag for forum topics on a forum type website? I can think of a few options so far Snippet of first post. Title of the topic with templated trailing text Remove description tag completely Your thoughts and suggestions are greatly appreciated.
Intermediate & Advanced SEO | | Peter2640 -
Category pages in forums
I would like to hear feedback on the best SEO practice for forum category pages. An example would be a forum about cars. You can have a Chervorlet category which contains forums for every chevy model. Often this category page is simply a list of all the forums. If I noindex, follow the page then am I missing an opportunity? I am thinking of Google sitemaps for example where this page can be used for a category link. If I noindex the page, there probably isn't another great place for a sitemap to link to. I could fill out the page with wiki-like generic chevy information. Please share any thoughts or best practices.
Intermediate & Advanced SEO | | RyanKent0