If UGC on my site also exists elsewhere, is that bad? How should I properly handle it?
-
I work for a reviews site, and some of the reviews that get published on our website also get published on other reviews websites. It's exact duplicate content -- all user generated. The reviews themselves are all no-indexed; followed, and the pages where they live are only manually indexed if the reviews aren't duplicate. We leave all pages with reviews that live elsewhere on the web nofollowed. Is this how we should properly handle it? Or would it be OK to follow these pages regardless of the fact that technically, there's exact duplicate UGC elsewhere?
-
You bet Mitch! Glad to help and let me know if there's anything else I can help answer. Hopefully maybe you'll get a few other opinions as well. As I'm sure you know, that's often valuable in search with so many nuances to the SEO game.
Good luck with your search efforts!
-
Definitely -- would still be nice to hear another opinion or two, but Todd was very specific and thorough. I've got some great, actionable takeaways from this conversation.
-
Really helpful thoughts all around. Sounds like we might continue to no-index the content for now (we assume that the descriptions of the programs are duplicate, since there's no way for us to efficiently check if people uploading program listings are just copy-pasting from their website -- reviews usually are the unique piece of content that allows us to move a page from noindexed to indexed).
Also, thanks for bringing the leave-a-review URLs to our attention -- I'll bring it up with my team this week!
Thanks again, Todd!
-
Did that help, Mitch?
-
Hey Mitch,
Thanks for the clarification--I think I understand your situation a little better now. Let me ask you this, are the pages your reviews sit on significantly different than the pages with the same reviews that your competitors have? Meaning, is the only cross-over the review portion of the content?
To answer your adjusted question, I would personally say no--review content is not different than any other type of content that could be construed as duplicate. I am wondering if you could solve your issue by differentiating the pages you have with reviews that match your competitors by adding other types of content to them. This might help add valuable context for a search engine as well as differentiate the page enough to help an engine sort out that they are different even though there is some content overlap. Just a thought.
My other thought on this is that maybe it's worth setting up a test? This is certainly a gray area and there are probably people who would have differing opinions from mine, so perhaps a good next step is planning and working on a test to see what happens with a small portion of pages?
If the content isn't thin, it sounds like you shouldn't have an issue with an algo like panda, so I don't see a huge risk in the test from what I understand of your situation.
If I've got your site right, I'm guessing you're asking about pages like this: http://www.gooverseas.com/study-abroad/austria/ies-abroad/47342 and whether or not you'd allow them to be indexed because the reviews at the bottom might be on other review sites. Again, if the content on the rest of the page is significant and not the same as what's on other similar pages, I wouldn't worry to much about it. If it is, I'd run a test and see what you can do.
Without doing more research, that's the best I can offer at this point!
Oh, and you might want to look into this (2 of many)...
That does look like something that would get you hit by panda.
Hope that helps and sorry if I'm still not understanding the question correctly.
-
Understood -- however, 1. It provides value and matches common user queries (i.e. "University of Michigan study abroad program reviews -- just made that exact query up though) 2. It's not lean content; we only think about indexing these pages when there are enough in-depth reviews (i.e paragraphs not a line or two). 3. I totally understand that that's usually the problem with duplicate content, but our competitors are ranking for these because we're being cautious of potential future algo updates and they're not -- so regardless of the fact that we're putting the content up first, they're getting the points.
My question is more along the lines of: is review content / user generated content treated differently than you traditional duplicate blog post? Is it OK if we index this page with reviews even though our competitor has already done so?
-
Personally, if they don't provide value for someone searching, I'd leave them noindexed. No reason to run the risk of an algo adjustment because of thin content. Duplicate content is mostly an issue because it makes it hard for search engines to determine which version to rank.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Handling alternate domains
Hi guys, We're noticing a few alternate hostnames for a website rearing their ugly heads in search results and I was wondering how everyone else handles them. For example, we've seen: alt-www.(domain).com test.(domain).com uat.(domain).com We're looking to ensure that these versions all canonical to their live page equivalent and we're adding meta robots noindex nofollow to all pages as an initial measure. Would you recommend a robots.txt crawler exclusion to these too? All feedback welcome! Cheers, Sean
Intermediate & Advanced SEO | | seanginnaw0 -
Adult Toys Sites
Does anyone know of any changes SEOwise when running an adult toy site versus a normal eCommerce site? Is there any tips or suggestions that are worth knowing to achieve rankings faster? Thanks,
Intermediate & Advanced SEO | | the-gate-films0 -
Launching a new website. Old inherited site cannot be saved after lifted penalty. When should we kill the old site and how?
Background Information A website that we inherited was severely penalized and after the penalty was revoked the site still never resurfaced in rankings or traffic. Although a dramatic action, we have decided to launch a completely new version of the website. Everything will be new including the imagery, branding, content, domain name, hosting company, registrar account, google analytics account, etc. Our question is when do we pull the plug on the old site and how do we go about doing it? We had heard advice that we should make sure we run both sites at the same time for 3 months, then deindex the old site using a noindex meta robots tag.We are cautious because we don't want the old website to be associated in any way, shape or form with the new website. We will purposely not be 301 redirecting any URLs from the old website to the new. What would you do if you were in this situation?
Intermediate & Advanced SEO | | peteboyd0 -
Mobile version of my sites: What is better?
What is the best approach to make my sites ready for mobile, in terms of SEO ? Is it better to create a subdomain called "m.mydomain.com" and redirect mobile users to that domain with a lite version of my sites? Or is it better to just keep the same domain as for my desktop version "mydomain.com" and use a WordPress theme that fits for all gadgets, for example Twenty Fourteen WordPress Theme, that adapts to each device? I see that most big sites use a "m.mydomain.com" subdomain for the mobile version, however, I don't see any sense in creating a subdomain of the site, when you can just use the WP adapting theme in the main domain. Any insight please? Thanks!
Intermediate & Advanced SEO | | BloggerGuy0 -
Why my site it's not being indexed?
Hello.... I got to tell that I feel like a newbie (I am, but know I feel like it)... We were working with a client until january this year, they kept going on their own until september that they contacted us again... Someone on the team that handled things while we were gone, updated it´s robots.txt file to Disallow everything... for maybe 3 weeks before we were back in.... Additionally they were working on a different subdomain, the new version of the site and of course the didn't block the robots on that one. So now the whole site it's been duplicated, even it´s content, the exact same pages exist on the suddomain that was public the same time the other one was blocked. We came in changes the robots.txt file on both server, resend all the sitemaps, sent our URL on google+... everything the book says... but the site it´s not getting indexed. It's been 5 weeks now and no response what so ever. We were highly positioned on several important keywords and now it's gone. I now you guys can help, any advice will be highly appreciated. thanks Dan
Intermediate & Advanced SEO | | daniel.alvarez0 -
Optimal site structure for travel site
Hi there, I am seo-managing a travel website where we are going to make a new site structure next year. We have about 4000 pages on the site at the moment. The structure is only 2-levels at the moment: Level 1: Homepage Level 2: All other pages (4000 individual pages - (all with different urls)) We are adding another 2-3 levels, but we have a challenge: We have potentially 2 roads to the same product (e.g. "phuket diving product") domain.com/thailand/activities/diving/phuket-diving-product.asp domain.com/activities/diving/thailand/phuket-diving-product.asp I would very much appreciate your view on the problem: How do I solve this dilemma/challenge from a SEO standpoint? I want to avoid DC if possible, I also only want one landing page - for many reasons. And usability is of course also very important. Best regards, Chris
Intermediate & Advanced SEO | | sembseo0 -
Schema markup for videos: Are video schema tags only for use on video hosted by a site or do they also apply to embedded videos hosted on YouTube?
We do not currently have a native video hosting solution for our site and instead embed videos that are hosted on YouTube. Can video schema markup be used for YouTube hosted video? Thank you.
Intermediate & Advanced SEO | | lwalker0 -
Handling Similar page content on directory site
Hi All, SEOMOZ is telling me I have a lot of duplicate content on my site. The pages are not duplicate, but very similar, because the site is a directory website with a page for cities in multiple states in the US. I do not want these pages being indexed and was wanting to know the best way to go about this. I was thinking I could do a rel ="nofollow" on all the links to those pages, but not sure if that is the correct way to do this. Since the folders are deep within the site and not under one main folder, it would mean I would have to do a disallow for many folders if I did this through Robots.txt. The other thing I am thinking of is doing a meta noindex, follow, but I would have to get my programmer to add a meta tag just for this section of the site. Any thoughts on the best way to achieve this so I can eliminate these dup pages from my SEO report and from the search engine index? Thanks!
Intermediate & Advanced SEO | | cchhita0