Should our social network put all of our member profiles in the site map?
-
We're working on some changes to our site and want to add a site map file to give some hints to search engines on our member profiles. Our site has millions of member profiles. I want to ensure that Google indexes them.
Is there a benefit to submitting millions of profiles across multiple site maps?
Is it better to pick a sample of those and submit them? Most member profiles have links to other member profiles.
Is there any benefit to taking a single site map of 50k links and then changing it at some frequency so that all of the member profiles are eventually indexed?
Thanks.
-
This was the approach we were considering. However, what gave me pause was looking at other social networks are doing.
- LinkedIn only has 50k profiles.
- Meez has multiple index files and looks like they are indexing many of their profiles
- Facebook and MySpace don't appear to use Sitemaps (although they do have a crawlable member directory)
- WeeWorld has 500 links
The point is there doesn't seem to be any consistency.
If we end up creating a human readable directory ala Facebook does that achieve the same thing?
-
Totally agree with mike and john.
-
I would definitely do this. Since you have so many profiles, you'll want to have one main sitemaps linking to smaller sitemaps with the profile URLs. One of the sites I work on has several million activities created by users that we put into sitemaps. We automatically generate our sitemaps files frequently and add the new activities created. We include a last modified date for each activity as well so the search bot will know if anything has changed since the last time it's indexed it.
I would create a sitemap system where all of your profiles could be found, and by including the last modified date, you can leave it up to the searchbot as to whether or not a profile has been updated and needs to be re-indexed. There are a couple other properties you could use listed on http://www.sitemaps.org/protocol.php as well.
-
Yes, we have the concept of public / private profiles. Private profiles aren't included in the index.
-
Benefiting or not, make sure users have the ability to turn this off to avoid privacy problems.
It might create a mess though if they link back and forth.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should I establish a Webmaster Tools site per language?
Our company services multiple regions. Our website is setup for France, International (en-gb), Spanish, United States and China. The websites share a common template and format and menu tree but each has unique content. Should I use a single Google Webmaster Tools site for all of these or establish each of them as a unique website?
On-Page Optimization | | bearpaw0 -
Is it bad to include google Maps in footer?
We have 5 locations and we were thinking about including a map for each location in the footer. These would be set-up as no-follow links. They could potentially enhance user experience but it also increases size of footer. Right now there are just basic links to pages (sitemap, terms, etc), contact info, social links, and contact form. If we did the maps it would also include link to the individual location pages. Not sure if we are doing too much in footer or need to just keep it basic. Thanks for the help!
On-Page Optimization | | Restore0 -
Latest news in site-wide footer?
I've asked my web team to add a section to our home page to showcase our latest news and content (articles, blog entries (same domain), white papers, case studies, etc.) I think it will be a good user experience and also provide an opportunity to keep a fairly stagnant home page updated with fresh content. My web team wants to add the section to our footer, which is site-wide. I'm sure this isn't a bad user experience, but will it cause problems or eliminate any SEO value (if any) for this regularly updating content?
On-Page Optimization | | mbrusyo0 -
Can I use the same text in my meta description as I put in my post excerpt?
Hi, I'm just trying to understand the right way to optimise my blog posts and this is likely a dumb question... but to what extent should the text in my meta description differ from the text in my post excerpts? cheers, Andrew
On-Page Optimization | | seowhiskey0 -
Moving content from one site to another
I have a couple established, content rich sites with some content that I would like to move over to a new site. My question is what steps I need to take to ensure that neither my older sites nor newer sites are penalized for duplicate content. The purpose for moving the content is to add some depth to the new site for users, as well as possibly optimize it all for SEO. There is a fair amount of content involved, about 50 posts and pages per site, so I'd like to know if the potential problem with duplicate content might be serious enough that I should think twice. What do you recommend?
On-Page Optimization | | LeeAbrahamson0 -
Best practice for introducing new landing page to my site?
I have a client, and want to know the best way to add new, keyword specific landing pages to their site and link to it in a logical way that isn't spammy. Example: My homepage targets “Adelaide Cars” I also want to target “Melbourne Cars” which I would do via a targeted landing page. How then would I logically link to this landing page? As Google gets better at spotting un-natural content, I’d like to know how to introduce this new page to get the best traction. If I was to just create the page, it would not make sense to have it in the main navigation. Same goes from various industry type terms. Eg. pest control and exterminator. How do you target both and still have a logical sitemap and page structure that Google will like and make sense to users.
On-Page Optimization | | letgo3450 -
Anchor text in Ecommerce site without relevant pages
I'm posting articles to my e-commerce site and just wondering about the anchor text links within the posts. I don't have relevant static pages but the items do come up in a search query. For example i don't have a specific page for red wine but if a user searched for red wine it would give a search query URL. Should I use that search URL query as my anchor text?
On-Page Optimization | | acs1110 -
Canonical Tag for Ecommerce Site
I implemented a canonical tag on each product page for my clients ecommerce site and my rankings tanked. Has this happened to anyone else? If so, when can I expect rank to return?
On-Page Optimization | | DynoSaur0