Should our social network put all of our member profiles in the site map?
-
We're working on some changes to our site and want to add a site map file to give some hints to search engines on our member profiles. Our site has millions of member profiles. I want to ensure that Google indexes them.
Is there a benefit to submitting millions of profiles across multiple site maps?
Is it better to pick a sample of those and submit them? Most member profiles have links to other member profiles.
Is there any benefit to taking a single site map of 50k links and then changing it at some frequency so that all of the member profiles are eventually indexed?
Thanks.
-
This was the approach we were considering. However, what gave me pause was looking at other social networks are doing.
- LinkedIn only has 50k profiles.
- Meez has multiple index files and looks like they are indexing many of their profiles
- Facebook and MySpace don't appear to use Sitemaps (although they do have a crawlable member directory)
- WeeWorld has 500 links
The point is there doesn't seem to be any consistency.
If we end up creating a human readable directory ala Facebook does that achieve the same thing?
-
Totally agree with mike and john.
-
I would definitely do this. Since you have so many profiles, you'll want to have one main sitemaps linking to smaller sitemaps with the profile URLs. One of the sites I work on has several million activities created by users that we put into sitemaps. We automatically generate our sitemaps files frequently and add the new activities created. We include a last modified date for each activity as well so the search bot will know if anything has changed since the last time it's indexed it.
I would create a sitemap system where all of your profiles could be found, and by including the last modified date, you can leave it up to the searchbot as to whether or not a profile has been updated and needs to be re-indexed. There are a couple other properties you could use listed on http://www.sitemaps.org/protocol.php as well.
-
Yes, we have the concept of public / private profiles. Private profiles aren't included in the index.
-
Benefiting or not, make sure users have the ability to turn this off to avoid privacy problems.
It might create a mess though if they link back and forth.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Rel-nofollow for price comparison site?
I run a price comparison site, so we have TONS of outbound links. Should my outbound links be marked with 'rel=nofollow'?
On-Page Optimization | | lancerpanz0 -
Do i have to optimize all pages on ecommerce site which is currently 4028 give or take
Hello, do i have to optimize all pages on ecommerce site, as its a lot of pages to developed unique content for my plan at the moment is to start from top down, I have completed top home, featured products etc i have also started on individual team shops my content inst unique to each page more the same and just changing the team name and keyword i was planning on doing that in the blog area of the site and just making the top categories and sub categories. and maybe in time start on the products. I can do all categories in about two months but to complete products would take like 2 years I don't feel that is productive and most would be changed or out of stock by then please take a look at my site and tell me what you think ? sportingdesires.com Kindest Regards, Stephen Kewn
On-Page Optimization | | sportingdesires0 -
Duplicate content issue, across site domains (blogging)
Hi all, I've just come to learn that a client has been cross-posting their blog posts to other blogs (on higher quality domains, in some cases). For example - this is the same post on 3 different blogs. http://thebioethicsprogram.wordpress.com/2014/06/30/how-an-irb-could-have-legitimately-approved-the-facebook-experiment-and-why-that-may-be-a-good-thing/
On-Page Optimization | | ketanmv
http://blogs.law.harvard.edu/billofhealth/2014/06/29/how-an-irb-could-have-legitimately-approved-the-facebook-experiment-and-why-that-may-be-a-good-thing/
http://www.thefacultylounge.org/2014/06/how-an-irb-could-have-legitimately-approved-the-facebook-experimentand-why-that-may-be-a-good-thing.html
And, sometimes a 4th time, on an NPR website. I'm assuming this is doing no one any favors and Harvard or NPR is going to earn the rank most every time. I'm going to encourage them to publish only fresh content on their real blog, would you agree? Can this actually harm the ranking of their blog and website - should we delete the old entries when migrating the blog? They are going to move their Wordpress Blog to hosting on their real domain soon:
http://www.bioethics.uniongraduatecollege.edu/news/ The current set up is not adding any value to their domain. Thank you for any advice! Ketan0 -
Simple on-site SEO - bet practice for keywords in content
Hello, The Moz on-page grader will give a grade of A if the keyword appears exactly in the content at least one time. If there are 500 words and a lot of it is about the main keyword, what have you found to be important to look for beyond the on-page grader - beyond the one exact instance of the keyword? I'm specifically talking just about keywords in the content. My guess is that it needs to occur 3 or 4 times in different forms and at least once exactly, but the on-page grader doesn't require it. What have you found?
On-Page Optimization | | BobGW0 -
Things to put in your page Title
Hello! I have a wordpress based blog/website and I was wondering what were the most important things to put in my title. I'm a wedding photographer. I think the location of the shoot is important and the fact that it's wedding photography, but is it important to try and put my company name (Celynnen Photography) in it too?! It's very hard to keep the titles short! Ioan
On-Page Optimization | | IoanSaid0 -
Yesterday our site had a page rank of 5, today not ranked.
All pages on our site as of today are showing current page is not ranked by google, we have been page rank 5 for about 4 years now, we still seem to be showing in google searches. Anyone have any ideas as to why?
On-Page Optimization | | wcuk0 -
My site has been dropping, not sure why!
My site has been dropping in the rankings, not sure - my metrics seem better than my competitors. Historically I have been a very stable #2 for my main term, but now it's down to 7! According to SEO Moz, my domain authority is 32, while my better performing competitors are are 26, 11, and 1! Have more links than they do. Trying to think it through, not sure what is happening. My home page bounces at a low 20%-ish, other Google Analytics are good. I have a company Facebook account, occasionally upload YouTube vids, do online press releases, etc. I do have to target several metros scattered across the state, while my competitors usually focus on one major metro. I do have some SEO Moz errors, which focus on dup content due to our web editor's naming system. An example would be domain.com/keyword-keyword-i-14 vs. domain/differnet keyword-different better keyword-i-14. 14 would be the actual page number. Our system lets me change the page title keywords, as I've added new links and pages over the years there are some dupes. The only major change is I've added a password protected section for sales rep materials. The hosting/web guru firm we use has assured me Google doesn't see pages behind the password portection. Not sure if Google is testing a new SERP formula. All social media or non-website results seem to have dropped out of search for my terms. Just local business sites like mine and some directory sites remain. Any advice or private consult would be greatly appreciated as I am a ... self taught 'OneManBand' for high tech marketing in our company. Thanks
On-Page Optimization | | OneManBand0 -
Does anyone have any experience with using Altruik for optimizing a retail site?
Greetings - can anyone offer an opinion on the services of http://www.Altruik.com/? They claim to be able to effectively optimize the deep pages of online retailers. I welcome any and all feedback! Eric
On-Page Optimization | | Ericc220