Should our social network put all of our member profiles in the site map?
-
We're working on some changes to our site and want to add a site map file to give some hints to search engines on our member profiles. Our site has millions of member profiles. I want to ensure that Google indexes them.
Is there a benefit to submitting millions of profiles across multiple site maps?
Is it better to pick a sample of those and submit them? Most member profiles have links to other member profiles.
Is there any benefit to taking a single site map of 50k links and then changing it at some frequency so that all of the member profiles are eventually indexed?
Thanks.
-
This was the approach we were considering. However, what gave me pause was looking at other social networks are doing.
- LinkedIn only has 50k profiles.
- Meez has multiple index files and looks like they are indexing many of their profiles
- Facebook and MySpace don't appear to use Sitemaps (although they do have a crawlable member directory)
- WeeWorld has 500 links
The point is there doesn't seem to be any consistency.
If we end up creating a human readable directory ala Facebook does that achieve the same thing?
-
Totally agree with mike and john.
-
I would definitely do this. Since you have so many profiles, you'll want to have one main sitemaps linking to smaller sitemaps with the profile URLs. One of the sites I work on has several million activities created by users that we put into sitemaps. We automatically generate our sitemaps files frequently and add the new activities created. We include a last modified date for each activity as well so the search bot will know if anything has changed since the last time it's indexed it.
I would create a sitemap system where all of your profiles could be found, and by including the last modified date, you can leave it up to the searchbot as to whether or not a profile has been updated and needs to be re-indexed. There are a couple other properties you could use listed on http://www.sitemaps.org/protocol.php as well.
-
Yes, we have the concept of public / private profiles. Private profiles aren't included in the index.
-
Benefiting or not, make sure users have the ability to turn this off to avoid privacy problems.
It might create a mess though if they link back and forth.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
When does updating site content affect SERPS?
Can any of you shine a light as to when updating content on a website had any effect on its 'general' placement in the search engines? I appreciate that for an online newspaper, it must be important, but has anyone noticed from theirs or a client's site that by not uploading i.e. product descriptions or articles in general, that their site has taken a hit?
On-Page Optimization | | SDavis110 -
Best Site Architecture tool for analysis my & competitors site?
Hello All, I am really confused with my current architecture for Ecommerce site, can you please suggest any tool or software where I can analysis mine and competitors site architecture ? Thanks!
On-Page Optimization | | pragnesh96390 -
Creating a .cn site with the existing site content
Hi all, I'm planning to create a .cn site. If I simply translate the existing content on my site (.com.au) into Chinese, do you think Google will see the .cn site as a duplicate of the main site? Will this cause any duplicate content issues? Thanks
On-Page Optimization | | QuantumWeb620 -
URL Structure for Home Decorating site
Hi, I am about to launch a home decorating ideas website. I am stuck to determining the ideal URL structure, and the options are: Category: myhomedecoratingsite.com/room/master-suite/
On-Page Optimization | | adepalma
myhomedecoratingsite.com/kitchen/
myhomedecoratingsite.com/room/living
myhomedecoratingsite.com/master-suite/
myhomedecoratingsite.com/living-room/ Post: myhomedecoratingsite.com/interior/beautiful-master-suite/
myhomedecoratingsite.com/interior/cozy-living-room/
myhomedecoratingsite.com/room/master-suite/beautiful-modern-suite/
myhomedecoratingsite.com/room/living/cozy-contemporary-living Are these any good? What your best suggestion? Thanks in advance for your inputs. Al0 -
Mentioning own site and keywords on here?
I have noticed that sometimes posters will talk about a site without mentioning what it is. I assume this is because it one of their clients so there is confidentiality, is there any other reason I should be aware of? its just that as I am new I am usually cautious and am considering posting my own site and mentioning all my keywords to ask for people’s verdict for my on-page SEO. Still working on it, will be ready soon, thought I would ask in advance. Regards,
On-Page Optimization | | Zoolander0 -
How do I Avoid Excessive Internal Links on an eCommerce site?
I think I'm getting dinged for this on Term Target because the page is full of products, which have links to their product page, but I'm not sure.
On-Page Optimization | | PageLogic0 -
Site structure for services and blog articles
Hi, looking for some advice on the structure for a relatively small site (around 200 pages). I'd like a structure where we can talk about our services as well as write blog articles on topics that relate to our services. We'll have loads more content in the blog area than in the services area. I was thinking of this: option 1: /services /services/copywriting
On-Page Optimization | | JaspalX
/services/social-media
/services/press-releases etc. and categories for articles where we'd give tips, talk about trends etc. /copywriting
/social-media
/effective-press-releases
etc. would it be better to have a different structure, say: option 2: /copywriting
/copywriting/services
/copywriting/articles OR option 3: /copywriting-services
/copywriting-blog OR option 4: /services/copywriting
/blog/copywriting OR is there another, better way perhaps? Of course the internal anchor text links to the services/blog articles pages will be tuned to try and make it clear what each section is about i.e. our services vs. industry trends/comments/tips for the blog.0 -
Prioritize Cities Instead of Counties or Countries in Site Architecture
I am designing the structure of a large travel webiste and have the following problem. The obvious structure from a users perspective would be to structure locations as follows: Home/Hotels/Country/County/City i.e. Home/Hotels/UK/Lancashire/Preston The problem is, it is the cities that I need closer to the root directory, instead of countries and counties. If I did Home/Hotels/City or even Home/Hotels/Country/City There may be too many links on one page and google may think they're spammy. How can I get the cities closer to the root directory as they are the most important pages on the site. Even if I did a text based sitemap I would encounter the same problem. *scratches head! Thanks in Advance, Nick UPDATE_________________________________________________________ Sorry I may have phrased the question wrongly. I should have said that I need the city pages to be less clicks from the root directory, as opposed to their actual URL structure. Ideally, I want to be able to access the city pages before the county and country pages on the site, as they are more important. Thanks A Bunch
On-Page Optimization | | Townpages0