If UGC on my site also exists elsewhere, is that bad? How should I properly handle it?
-
I work for a reviews site, and some of the reviews that get published on our website also get published on other reviews websites. It's exact duplicate content -- all user generated. The reviews themselves are all no-indexed; followed, and the pages where they live are only manually indexed if the reviews aren't duplicate. We leave all pages with reviews that live elsewhere on the web nofollowed. Is this how we should properly handle it? Or would it be OK to follow these pages regardless of the fact that technically, there's exact duplicate UGC elsewhere?
-
You bet Mitch! Glad to help and let me know if there's anything else I can help answer. Hopefully maybe you'll get a few other opinions as well. As I'm sure you know, that's often valuable in search with so many nuances to the SEO game.
Good luck with your search efforts!
-
Definitely -- would still be nice to hear another opinion or two, but Todd was very specific and thorough. I've got some great, actionable takeaways from this conversation.
-
Really helpful thoughts all around. Sounds like we might continue to no-index the content for now (we assume that the descriptions of the programs are duplicate, since there's no way for us to efficiently check if people uploading program listings are just copy-pasting from their website -- reviews usually are the unique piece of content that allows us to move a page from noindexed to indexed).
Also, thanks for bringing the leave-a-review URLs to our attention -- I'll bring it up with my team this week!
Thanks again, Todd!
-
Did that help, Mitch?
-
Hey Mitch,
Thanks for the clarification--I think I understand your situation a little better now. Let me ask you this, are the pages your reviews sit on significantly different than the pages with the same reviews that your competitors have? Meaning, is the only cross-over the review portion of the content?
To answer your adjusted question, I would personally say no--review content is not different than any other type of content that could be construed as duplicate. I am wondering if you could solve your issue by differentiating the pages you have with reviews that match your competitors by adding other types of content to them. This might help add valuable context for a search engine as well as differentiate the page enough to help an engine sort out that they are different even though there is some content overlap. Just a thought.
My other thought on this is that maybe it's worth setting up a test? This is certainly a gray area and there are probably people who would have differing opinions from mine, so perhaps a good next step is planning and working on a test to see what happens with a small portion of pages?
If the content isn't thin, it sounds like you shouldn't have an issue with an algo like panda, so I don't see a huge risk in the test from what I understand of your situation.
If I've got your site right, I'm guessing you're asking about pages like this: http://www.gooverseas.com/study-abroad/austria/ies-abroad/47342 and whether or not you'd allow them to be indexed because the reviews at the bottom might be on other review sites. Again, if the content on the rest of the page is significant and not the same as what's on other similar pages, I wouldn't worry to much about it. If it is, I'd run a test and see what you can do.
Without doing more research, that's the best I can offer at this point!
Oh, and you might want to look into this (2 of many)...
That does look like something that would get you hit by panda.
Hope that helps and sorry if I'm still not understanding the question correctly.
-
Understood -- however, 1. It provides value and matches common user queries (i.e. "University of Michigan study abroad program reviews -- just made that exact query up though) 2. It's not lean content; we only think about indexing these pages when there are enough in-depth reviews (i.e paragraphs not a line or two). 3. I totally understand that that's usually the problem with duplicate content, but our competitors are ranking for these because we're being cautious of potential future algo updates and they're not -- so regardless of the fact that we're putting the content up first, they're getting the points.
My question is more along the lines of: is review content / user generated content treated differently than you traditional duplicate blog post? Is it OK if we index this page with reviews even though our competitor has already done so?
-
Personally, if they don't provide value for someone searching, I'd leave them noindexed. No reason to run the risk of an algo adjustment because of thin content. Duplicate content is mostly an issue because it makes it hard for search engines to determine which version to rank.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Handling alternate domains
Hi guys, We're noticing a few alternate hostnames for a website rearing their ugly heads in search results and I was wondering how everyone else handles them. For example, we've seen: alt-www.(domain).com test.(domain).com uat.(domain).com We're looking to ensure that these versions all canonical to their live page equivalent and we're adding meta robots noindex nofollow to all pages as an initial measure. Would you recommend a robots.txt crawler exclusion to these too? All feedback welcome! Cheers, Sean
Intermediate & Advanced SEO | | seanginnaw0 -
International Site Migration
Hi guys, In the process of launching internationally ecommerce site (Magento CMS) for two different countries (Australia and US). Then later on expand to other countries like the UK, Canada, etc. The plan is for each country will have its own sub-folder e.g. www.domain.com/us, www.domain.com.au/au, www.domain.com.au/uk A lot of the content between these English based countries are the same. E.g. same product descriptions.
Intermediate & Advanced SEO | | jayoliverwright
So in order to prevent duplication, from what I’ve read we will need to add Hreflang tags to every single page on the site? So for: Australian pages: United States pages: Just wanted to make sure this is the correct strategy (will hreflang prevent duplicate content issues?) and anything else i should be considering? Thankyou, Chris0 -
Moving from a static HTML CSS site with .html files to a Wordpress Site while keeping link structure
Mozzers, Hope this finds you well. I need some advice. We have a site built with a dreamweaver template, and it is lacking in responsiveness, ease of updates, and a lot of the coding is behind traditional web standards (which I know will start to hurt our rank - if not the user experience). For SEO purposes, we would like to move the existing static based site to Wordpress so we can update it easily and keep content fresh. Our current site, thriveboston.com, has a lot of page extensions ending in .html. For the transition, it is extremely important for us to keep the link structure. We rank well in the SERPs for Boston Counseling, etc... I found and tested a plugin (offline) that can add a .html extension to Wordpress pages, which allows us to keep our current structure, but has anyone had any luck with this live? Has anyone had any luck moving from a static site - to a Wordpress site - while keeping the current link structure - without hurting any rank? We hope to move soon because if the site continues to grow, it will become even harder to migrate the site over. Also, does anyone have any hesitations? It this a bad move? Should we just stay on the current DWT template (the HTML and CSS) and not migrate? Any suggestions and advice will be heeded. Thanks Mozzers!
Intermediate & Advanced SEO | | _Thriveworks0 -
PDF on financial site that duplicates ~50% of site content
I have a financial advisor client who has a downloadable PDF on his site that contains about 9 pages of good info. Problem is much of the content can also be found on individual pages of his site. Is it best to noindex/follow the pdf? It would be great to let the few pages of original content be crawlable, but I'm concerned about the duplicate content aspect. Thanks --
Intermediate & Advanced SEO | | 540SEO0 -
Site Structure Question
Hi All, Got a question about site structure, I currently have a website where everything is hosted on the root of the domain. See example below: site.com/men site.com/men-shorts site.com/men-shorts-[product name] I want to change the structure to site.com/men/shorts/[product-name] I have asked a couple of SEOs and some agree with me that the structure needs to be changed and some say that as long as I dictate the structure with internal links and breadcrumbs the URL structure doesn't matter... What do you guys think? Many thanks, Carlos
Intermediate & Advanced SEO | | Carlos-R0 -
Do I have to tell WBT site moved to a subdirectory on another internal site?
I am moving content from one site to another and redirecting the DNS from www.oldsite.com to www.newsite.com/old-site. I have put the 301 in place but I wanted to make sure I have to also tell Webmaster Tools to change the old site to the new domain? We still want the old domain name to answer and redirect to www.newsite.com/old-site. Thanks
Intermediate & Advanced SEO | | GeorgeLaRochelle0 -
One platform, multiple niche sites: Worth $60/mo so each site has different class C?
Howdy all, The short of it is that I currently run a very niche business directory/review website and am in the process of expanding the system to support running multiple sites out of the same database/codebase. In a normal setup I'd just run all the sites off of the same server with all of them sharing a single IP address, but thanks to the wonders of the cloud, it would be fairly simple for me to run each site on it's own server at a cost of about $60/mo/site giving each site a unique IP on a unique c-block (in many cases a unique a-block even.) The ultimate goal here is to leverage the authority I've built up for the one site I currently run to help grow the next site I launch, and repeat the process. The question is: Is the SEO-value that the sites can pass to each other worth the extra cost and management overhead? I've gotten conflicting answers on this topic from multiple people I consider pretty smart so I'd love to know what other people say.
Intermediate & Advanced SEO | | qurve0 -
Can this site be optimised?
I have been told that because of the technology this site was developed with it cannot be changed for example urls title and meta tags cannot be changed. why is that and what other types of sites also cannot be changed. http://www.alliedpickfords.com/Pages/Landing.aspx For example i have been told alot of online stores cannot be optimised because the urls change every time some one goes to the page therefor you cant lionk to a certain page is that true and what is the way around it if any.
Intermediate & Advanced SEO | | duncan2740