SEO for an exponentially growing site?
-
Hey Mozers!
I was having a quick chat with a friend the other day on doing SEO for a site that grows in page size at an exponential rate and was just wondering how you would go about optimizing it?
The example that we used would be a site that allowed users to upload videos and then have people vote on two videos against each other. So, if there are 100 uploaded videos and each of them are pared up with the other 99 to create a unique voting/battle page which has it's own unique URL, the site can get very large, VERY quickly. Meaning if just one more video is uploaded there would be
How exactly would you go about optimizing the site?
My biggest area of confusion would be generating sitemaps. I'm aware of best practices with large sitemaps (i.e. having a sitemap of sitemaps, not going over 50k in entries per sitemap etc..) But, how would you go about creating the sitemaps for this website if it's growing at an exponential rate, if at all?
If you have any other questions feel free to ask and I'll clarify it.
Thanks!
**TL;DR How would you optimize a site that grows at an exponential rate? **
-
Sorry, I wasn't very clear in what I initially responded back with.The code that I use doesn't create a new sitemap but rather just adds an additional node to the current one whenever a new page is added, so yes I am using the type of sitemap code that you are referring to.
BUT, since the site grows at an exponential rate it means that for every one video uploaded it will be matched up with each and every other single video to create a unique URL for each combination.
As an example if there are 10,000 videos currently on site which means there are 2 sitemaps right now and ONE more video is uploaded that means that 10,000 NEW unique urls/pages will be created thus creating 2 additional sitemaps resulting in a total of 4 sitemaps because of one new video being uploaded.
Let me know if I need to clarify anything.
-
Hello Jordan,
I am not sure what your using, but generally just because a video was uploaded to a site doesn't mean that it creates a new sitemap, for example in WordPress if you upload a video, it will get added to an existing sitemap. So when a search engine such as Google crawls it again, it will see the updated sitemap. So a automatic sitemap should work fine for you, unless your using a system that generates a new sitemap for everything uploaded, I have never heard of that, but I guess it's possible. If that's the case I am not sure at all. Very sorry I couldn't be of more assistance to you.
Have a great day and a happy holidays.
MB
-
Automatically generating sitemaps wasn't my concern it was more if you have 2 sitemaps worth of videos and then a user uploads just one more video that will end up creating an entire additional sitemap just because one more video was uploaded.
Thoughts?
-
Just as a note I would use dynamic meta tags that pull from titles, descriptions, for your meta info for each page so you don't run into duplicate meta issues. As for the sitemaps, that's a great question, I know there are many automated systems you can plugin to your site to auto generate sitemaps. I wish I knew more about them. I personally use WordPress for just about everything now, because it's easy to use and it has 1000's of useful plugins.
Have a great night.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My site shows 503 error to Google bot, but can see the site fine. Not indexing in Google. Help
Hi, This site is not indexed on Google at all. http://www.thethreehorseshoespub.co.uk Looking into it, it seems to be giving a 503 error to the google bot. I can see the site I have checked source code Checked robots Did have a sitemap param. but removed it for testing GWMT is showing 'unreachable' if I submit a site map or fetch Any ideas on how to remove this error? Many thanks in advance
Intermediate & Advanced SEO | | SolveWebMedia0 -
Yoast Seo Plugin
When I view html code of our website, I see this from yoast plugin this. I guess there is really something wrong, especially the page 2? Why so many meta? When ask the support team of the plugin, the developer said me that it is caused by the theme. <html xmlns="<a class="attribute-value">http://www.w3.org/1999/xhtml</a>" lang="<a class="attribute-value">en-US</a>"><head><meta http-equiv="<a class="attribute-value">Content-Type</a>" content="<a class="attribute-value">text/html; charset=UTF-8</a>" /><meta name="<a class="attribute-value">google-site-verification</a>" content="<a class="attribute-value">hRZ9ZRlCURkbiJA5Ewf6VJlSfGZipdXnumAKlHcrHaQ</a>" /><title>Villas Diani | Kenya Luxury Beach Holidaystitle><link rel="<a class="attribute-value">stylesheet</a>" href="[http://villasdiani.com/wp-content/themes/decorum/style.css](view-source:http://villasdiani.com/wp-content/themes/decorum/style.css)" type="<a class="attribute-value">text/css</a>" media="<a class="attribute-value">screen</a>" /><link rel="<a class="attribute-value">alternate</a>" type="<a class="attribute-value">application/rss+xml</a>" title="<a class="attribute-value">RSS Feed</a>" href="[http://villasdiani.com/feed/](view-source:http://villasdiani.com/feed/)" /><link rel="<a class="attribute-value">pingback</a>" href="[http://villasdiani.com/xmlrpc.php](view-source:http://villasdiani.com/xmlrpc.php)" /><meta name="<a class="attribute-value">description</a>" content="<a class="attribute-value">Indian Ocean Villas in Kenya, Diani Beach Resort. Find Diani beach Accommodation and Information for Luxury Beach Holidays in Kenya</a>"/><link rel="<a class="attribute-value">canonical</a>" href="[http://villasdiani.com/](view-source:http://villasdiani.com/)" /><link rel="<a class="attribute-value">next</a>" href="[http://villasdiani.com/page/2/](view-source:http://villasdiani.com/page/2/)" /><link rel="<a class="attribute-value">author</a>" href="[https://plus.google.com/u/0/108558298587711226912/posts](view-source:https://plus.google.com/u/0/108558298587711226912/posts)"/><link rel="<a class="attribute-value">publisher</a>" href="[https://plus.google.com/u/0/108558298587711226912/posts](view-source:https://plus.google.com/u/0/108558298587711226912/posts)"/><meta property="<a class="attribute-value">og:locale</a>" content="<a class="attribute-value">en_US</a>"/><meta property="<a class="attribute-value">og:type</a>" content="<a class="attribute-value">website</a>"/><meta property="<a class="attribute-value">og:title</a>" content="<a class="attribute-value">Villas Diani | Kenya Luxury Beach Holidays</a>"/><meta property="<a class="attribute-value">og:description</a>" content="<a class="attribute-value">Kenya Diani Beach Villas, Luxury Villa Rentals</a>"/><meta property="<a class="attribute-value">og:url</a>" content="<a class="attribute-value">http://villasdiani.com/</a>"/><meta property="<a class="attribute-value">og:site_name</a>" content="<a class="attribute-value">Villas Diani | Kenya Luxury Beach Holidays</a>"/><meta property="<a class="attribute-value">article:publisher</a>" content="<a class="attribute-value">https://www.facebook.com/VillasDianiBeach</a>"/><meta property="<a class="attribute-value">og:image</a>" content="<a class="attribute-value">http://villasdiani.com/wp-content/uploads/2012/08/alfajiri-cliff-villa-diani-kenya.jpg</a>"/>
Intermediate & Advanced SEO | | Rebeca10 -
Why Did My Site Go Limp On Me?
One of my clients was once in the #1 position for "Philadelphia interior designer" and other related terms, but her site has dropped significantly. Still it is on the first page, but far from its former glory. http://www.interiorsbydonnahoffman.com is the site. What really confuses me is why in her home turf search of "Bucks County Interior Designer" a competitor, http://www.miriamansellinteriors.com, is above her in the SERPS. According to OSE her competitor has a PA of 32 vs my client's 39. My client has 35 Linking Root Domains (and some of high quality) compared to just 11 for the competition. In all aspects her competitor looks weaker and less relevant to me. Her site has been weak in the SERPs since May/June. We are redesigning her site- she has a high bounce rate compared to my other interior design clients, something like 55%. Any insights from y'all?
Intermediate & Advanced SEO | | dfhytrwy0 -
Merging Sites: Will redirecting the old homepage to an internal page on the new site cause issues?
I've ended up with two sites which have similar content (but not duplicate) and target similar keywords, rather than trying to maintain two sites I would like to merge the sites together. The old site is more of a traditional niche site and targets a particular set of keywords on its homepage, the new site is more of an authority site with a magazine type homepage and targets the same set of keywords from an internal page. My question is: Should I redirect the old site's homepage to the relevant internal page on the new website...
Intermediate & Advanced SEO | | lara_dar
...or should I redirect the old site's homepage to the new site's homepage? (the old site's homepage backlinks are a mixture of partial match keyword anchor text, naked URLs and branded anchor text) I am in two minds (a & b!) (a) Redirecting to the internal page would be great for ranking as there are some decent backlinks and the content is similar (b) But usually when you do a 301 redirect the homepage usually directs to the new homepage and some of the old site's links are related to the domain rather than the keyword (e.g. http://www.site.com) and some people will be looking for the site's homepage. What do you think? Your help is much appreciated (and hope this makes sense...!)0 -
Severe health issues are found on your site. - Check site health (GWT)
Hi, We run a Magento website - When i log in to Google Webmaster Tools, I am getting this message: Severe health issues are found on your site. - <a class="GNHMM2RBFH">Check site health
Intermediate & Advanced SEO | | bjs2010
</a>Is robots.txt blocking important pages? Some important page is blocked by robots.txt. Now, this is the weird part - the page being blocked is the admin page of magento - under
www.domain.com/index.php/admin/etc..... Now, this message just wont go away - its been there for days now - so why does Google think this is an "important page"? It doesnt normally complain if you block other parts of the site ?? Any ideas? THanks0 -
Is this site legit?
http://www.gglpls.com/ is this site legit? Submit website to google + directory?
Intermediate & Advanced SEO | | SEODinosaur0 -
Google Algo update for over SEO'd sites: Is this a game changer?
This must be on the forum somewhere already but I cant find it. Google are updating there algo to penalise over SEO'd sites, is this a game changer? http://www.pcpro.co.uk/news/373630/google-to-demote-seo-heavy-sites Cheers
Intermediate & Advanced SEO | | activitysuper0 -
Badges For a B2b site
love this seo tactic but it seems hard to get people to adopt it Has anyone seen a successful badge campaign for a b2b site? please provide examples if you can.
Intermediate & Advanced SEO | | DavidKonigsberg0