SEO for an exponentially growing site?

[JordanChoo]

Hey Mozers!

I was having a quick chat with a friend the other day on doing SEO for a site that grows in page size at an exponential rate and was just wondering how you would go about optimizing it?

The example that we used would be a site that allowed users to upload videos and then have people vote on two videos against each other. So, if there are 100 uploaded videos and each of them are pared up with the other 99 to create a unique voting/battle page which has it's own unique URL, the site can get very large, VERY quickly. Meaning if just one more video is uploaded there would be

How exactly would you go about optimizing the site?

My biggest area of confusion would be generating sitemaps. I'm aware of best practices with large sitemaps (i.e. having a sitemap of sitemaps, not going over 50k in entries per sitemap etc..) But, how would you go about creating the sitemaps for this website if it's growing at an exponential rate, if at all?

If you have any other questions feel free to ask and I'll clarify it.

Thanks!

**TL;DR How would you optimize a site that grows at an exponential rate? **

[JordanChoo]

Sorry, I wasn't very clear in what I initially responded back with.The code that I use doesn't create a new sitemap but rather just adds an additional node to the current one whenever a new page is added, so yes I am using the type of sitemap code that you are referring to.

BUT, since the site grows at an exponential rate it means that for every one video uploaded it will be matched up with each and every other single video to create a unique URL for each combination.

As an example if there are 10,000 videos currently on site which means there are 2 sitemaps right now and ONE more video is uploaded that means that 10,000 NEW unique urls/pages will be created thus creating 2 additional sitemaps resulting in a total of 4 sitemaps because of one new video being uploaded.

Let me know if I need to clarify anything.

[MarketingOfAmerica]

Hello Jordan,

I am not sure what your using, but generally just because a video was uploaded to a site doesn't mean that it creates a new sitemap, for example in WordPress if you upload a video, it will get added to an existing sitemap.  So when a search engine such as Google crawls it again, it will see the updated sitemap.  So a automatic sitemap should work fine for you, unless your using a system that generates a new sitemap for everything uploaded, I have never heard of that, but I guess it's possible.  If that's the case I am not sure at all.  Very sorry I couldn't be of more assistance to you.

Have a great day and a happy holidays.

MB

[JordanChoo]

Automatically generating sitemaps wasn't my concern it was more if you have 2 sitemaps worth of videos and then a user uploads just one more video that will end up creating an entire additional sitemap just because one more video was uploaded.

Thoughts?

[MarketingOfAmerica]

Just as a note I would use dynamic meta tags that pull from titles, descriptions, for your meta info for each page so you don't run into duplicate meta issues.  As for the sitemaps, that's a great question, I know there are many automated systems you can plugin to your site to auto generate sitemaps.  I wish I knew more about them.  I personally use WordPress for just about everything now, because it's easy to use and it has 1000's of useful plugins.

Have a great night.