Should our social network put all of our member profiles in the site map?
-
We're working on some changes to our site and want to add a site map file to give some hints to search engines on our member profiles. Our site has millions of member profiles. I want to ensure that Google indexes them.
Is there a benefit to submitting millions of profiles across multiple site maps?
Is it better to pick a sample of those and submit them? Most member profiles have links to other member profiles.
Is there any benefit to taking a single site map of 50k links and then changing it at some frequency so that all of the member profiles are eventually indexed?
Thanks.
-
This was the approach we were considering. However, what gave me pause was looking at other social networks are doing.
- LinkedIn only has 50k profiles.
- Meez has multiple index files and looks like they are indexing many of their profiles
- Facebook and MySpace don't appear to use Sitemaps (although they do have a crawlable member directory)
- WeeWorld has 500 links
The point is there doesn't seem to be any consistency.
If we end up creating a human readable directory ala Facebook does that achieve the same thing?
-
Totally agree with mike and john.
-
I would definitely do this. Since you have so many profiles, you'll want to have one main sitemaps linking to smaller sitemaps with the profile URLs. One of the sites I work on has several million activities created by users that we put into sitemaps. We automatically generate our sitemaps files frequently and add the new activities created. We include a last modified date for each activity as well so the search bot will know if anything has changed since the last time it's indexed it.
I would create a sitemap system where all of your profiles could be found, and by including the last modified date, you can leave it up to the searchbot as to whether or not a profile has been updated and needs to be re-indexed. There are a couple other properties you could use listed on http://www.sitemaps.org/protocol.php as well.
-
Yes, we have the concept of public / private profiles. Private profiles aren't included in the index.
-
Benefiting or not, make sure users have the ability to turn this off to avoid privacy problems.
It might create a mess though if they link back and forth.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO Rankings Ebbs and Flows on Ecommerce Site - Normal?
Hey everyone, I should start by saying I'm very new to SEO (I'm actually just a copywriter that's taken on this role at an agency), so I apologize if I'm using some common terms incorrectly or if there's a lack of information. I've been optimizing my first ecommerce website (clothing company), and things were going very well last year. Strong surges in organic traffic, peaking in the summer. There was a drop before the holidays when the client dumped a ton of new product pages that weren't optimized. After optimizing the pages, the traffic went back up to its summer levels. Now, there's about a 10% drop in organic traffic since earlier this year, and a loss of just over 20% of keywords the site was originally ranking for. There's no sharp drop in the Analytics, but a steady decline. To give a better idea, the site was ranking for 5,270 keywords in February; it's dropped to 3,772 keywords in April. According to SEMRush, almost all the dropped keywords are the lower volume ones, maybe indicating long tail keywords? I'm really not sure what the cause of the drop is, as I've been following (I think) best on-page practices, which seems to have yielded results last year. One thing I should mention is the client has a unique product page for each variant of one product (so the same shirt will have 10 of the same pages, the only difference being the colour). Could Google be penalizing the site for duplicate content? It was fine last year though with that same site structure; I'm not sure how long it would take for Google to penalize a site for that. Sorry for the wall of text. I'd really appreciate any insight into this. Thanks Moz community!
On-Page Optimization | | EdenPrez3 -
Reducing number of site pages?
Hi, I am looking through my site structure and I have a lot of pages left over from the days of article keywords. Probably 7 or 8 years ago, someone sold my husband on article key word pages. I have slowly gotten rid of a lot of them as they have fallen out out of the ranks. I would like to get rid of the rest, probably 5 or 6 pages. Will it hurt my rankings to delete pages and redirect them? My customers really like the simplicity of our site and I want to keep it that way, plus clean up flags that Moz is telling me is a problem. I think its easier to keep less pages top notch than have to worry with a lot of them. Especially since my customers aren't viewing them. Thanks in advance!
On-Page Optimization | | CalicoKitty20000 -
Responsive site.com vs m.site.com
Hi All, My client's website have two urls like: site.com/a.html and **m.site.com/a.html. ** Will it hurt google rankings for this website because there are version of a website? Please help!
On-Page Optimization | | binhlai1 -
SEO audit on a beta site
HI there, Is there much point conducting an SEO site audit on a site that has not yet launched and is protected behind a login? Presumably none of the usual SEO tools (Moz, Screaming Frog etc) can crawl this site becuase it is all locked behind a login. Would it be better to launch it and then do a site audit? Thanks
On-Page Optimization | | CosiCrawley0 -
E-commerce site hit by the latest Panda, please help
Hello mates, Our site is an e-comerce site http://goo.gl/4QBVjR has been hit hard by the latest Panda on the last weekend as many other sites such as Retailmenot etc. We were working hard from one year til now:1. Rewrite all the pages with pour content (less than 100 words), and non-original content.2. The pages where was impossible rewrite the content were 410 gone.3. About the link profile, we were removing all the unnatural links by contacting thewebmaster and finally updating a DISAVOW file at monthly basis.All these tasks were performed and we see some improvements close to the original traffic before 2012Now from the last weekend our traffic down again, so we need to know if we can do anythingor there are something hidden from our eyes.Thank youClaudio
On-Page Optimization | | SharewarePros0 -
New jobboard: Can redirecting folder (site.com/jobboard) to subdomain (jobboard.site.com) hurt SEO?
Hi there, I'm planning to implement a jobboard on my website which needs to be installed on a subdomain (jobboard.site.com) but I'd really like to use site.com/jobboard for promoting this jobboard (jobboard collects external industry jobs). Are there any possible disadvantages when I set up a 301 redirect from jobboard.site.com to site.com/jobboard? Also: What if I want to move this jobboard to a unique domain one day (e.g. jobboard-industry-xy.com), Would that be tricky (as I'd basically have to redirect the folder-to-subdomain redirect to an external domain and therefore get a folder-to-subdomain-to-external-domain redirect...)? Cheers, Thomas
On-Page Optimization | | stl990 -
Things to put in your page Title
Hello! I have a wordpress based blog/website and I was wondering what were the most important things to put in my title. I'm a wedding photographer. I think the location of the shoot is important and the fact that it's wedding photography, but is it important to try and put my company name (Celynnen Photography) in it too?! It's very hard to keep the titles short! Ioan
On-Page Optimization | | IoanSaid0 -
Major update to site architecture (outline)-Is Google going to drop?
I'm working with a lawyer client who has a table-based, outdated site. Her nav links consist of a jumble of topics and static pages in one long sidebar list on the home page. I'm moving her site to Wordpress and I've recommended that she organize the site based on categories that roughly match the topics/keywords she wants to rank highest for in Google. The site will be much better organized and coded and the URLs for the new launch will be much stronger for SEO by being targeted and coded properly. So the site should rank better after, right? Right??? I know that when Google crawls the new architecture, it's not going to find the expected long sidebar list of internal nav links. It'll find better, more keyword targeted internal nav links. But will that keep the site from getting dropped off page 1? I'm speaking w/ the client tomorrow and if she's going to drop or get bounced around, I feel like I should prepare her and let her know roughly what might happen. I'm thinking based on my current understanding that I should tell her to expect to be bounced around for a few weeks, but in the end she should rank higher than before. What would you do/say?
On-Page Optimization | | bvrob0