Duplicate Forum Content
-
HI everyone,
great to be here, absolutely loving everything, please go easy on me I'm quite a noob when it comes to seo, but hopefully my question isn't too basic.
After running the initial checks on my websites, I found there are 7,646 duplicate pages? Some are easy fixes but the majority are not, being forum pages, the edit, quote and new post links are coming up as duplicates of the main post?
Does anyone know how to fix this?
Best Lee
-
How delightful that you refer to Invisionpower as I recently took the software for a test drive and plan to purchase it in January
A question though that has been troubling me. I use a paid for hosting service, which forwards to one of my sub-domains. The problem is I have nearly 7k pages of duplicate content (all from the forum), I really want to add a no follow and then remove the forum pages from the search index and thus remove all of the duplicate content. Though I'm worried that adding no follow to the sub domain may impact on the main site.
I have a lot of page one search positions, many long tails which combined result in a lot of visits, but I also have a couple of short phrases that get 50% of the visits alone, so I can't risk making any changes, actually I'm pretty terrified to make any changes, just in case all of my website pages are removed from the index.
-
invisionpower forum is good choice, as i knew. Found duplicated content pages here, it happens with most of forums, but there is full provision that this can resolved by canonical or stop crawling one you don't want in robots.txt.
-
Hey
just found some valuable info which has solved a lot of my problems, modified .htaccess which has removed all of the non www links, so thats a part solve.
I think what I'm going to do is purchase the new forum software, setup a robot.txt to not crawl the new forums and then once I have all of the posts transfered to the new forum, remove the old forums from the index.
That should solve it, the new forum is very well established and if need be I can pay one of their developers to incorporate some seo feature that will stop the duplicate content issue. Once thats solved I can remove the robot.txt
Many thanks, Lee
-
Hi, still one more thing, because you sound loss, and that's not the meaning of this Q&A. Contact the forumservice and ask for the canonical, this is a very simple and common thing to do.
-
Ok thanks Leonie,
still no nearer to knowing what to do, I know theres a problem and generally what I need to do, but I'm still at a complete loss as to how to do it
But thank you for trying to help,
Best, Lee
-
Seo stuff is'nt that difficult, though it can be comlicated
Anyway I wish you luck with the forum and hope you'll manage to get it the way you wanted.
Grtz, Leonie
-
Mmmm this is becoming more problematic by the minute, will need to implement robot.txt before removing the urls.
And there was me thinking this seo stuff would be easy.
-
Lol, tha'ts also an option
under url's index, though they have to be removed first, otherwise google crawl them again. but there you can remove complete directories at once.
-
or go somewhere else lol, have been considering buying invisionpower forum for a while, this might be the final push I needed.
Is there a way of mass deleting pages from the index in webmaster tools, i.e. all links that contain edit, quote and new ect?
-
Ah okay, that will be difficult than.
Maybe you can ask them to implement the canonical url. It will be helpful for you to avoid duplicates
-
is a paid forum service, but they give you the ability to add code snippets in the head.
-
Hi Lee,
What kind of CMS are you using?
In wmt under parameters you can configure parameters. If the ur's contain the same parameter it is a posibility.
-
Hi Leonie,
thanks for taking the time to answer
Not sure if that will work, there is only one head (hope that makes sense). Forums work pretty much the same as content management systems. I have the ability to change what's contained in the head, but adding rel="canonical" will have the same effect on all pages, even the duplicate one (I think).
Is there a way of removing all pages from the index (in webmaster tools) that contain the word edit, or quote or new? Kind of like using a wild card?
-
Hi Lee,
I'm not very familiar with forums. but i think you can solve it by putting a canonical in the head.
If you have a main page, which is the post, put a canonical url in it:
the duplicate pages need to have the same canonical.
I hope this work for you.
Grtz, Leonie
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What to do with outdated and irrelevant content on a website?
Hi everyone, On our corporate website we have a blog where we publish articles which are directly related to our company (house heating systems and gas cylinders) and some articles which are completely irrelevant to our core business, but which might be of interest to our potential clients. Recently I've been told that it is not a good idea to include these not directly related posts to our core business, because Google might be somewhat confused at to what our core business is all about. I was advised to research this topic and think of completely removing blog posts that are irrelevant to our core business from our blog. By removing I mean completely removing pages and setting a 410 status to tell Google that it is not a 404 error but that these pages were intentionally removed. I would like to hear some independent advice from Moz community as to what I should do? Thank you very much in advance.
Content Development | | Intergaz0 -
Duplicate Content & Tags
I've recently added tags to my blog posts so that related blog posts are suggested to visitors. My understanding was that my robot.txt was handling duplicate content so thought it wouldn't be an issue but after Moz crawled by site this week is reported 56 issues of duplicate content in my blog. I'm using Shopify, so I can edit the robot.txt file but is my understanding correct that if there are 2 or more tags then they will be ignored? I've searched the Shopify documents and forum and can't find a straight answer. My understanding of SEO is fairly limited. Disallow: /blogs/+
Content Development | | Tangled
Disallow: /blogs/%2B
Disallow: /blogs/%2b0 -
Blog for content
Noob here so be gentle... We have a blog on our homepage that we're using for content/SEO purposes. Does this content rank as highly as it would if it were a simple HTML page as opposed to a blogspot or wordpress from our page? In other words, are we getting as much content cred in this way as we would if blogspot wasn't affiliated? http://greatmats.blogspot.com/
Content Development | | Greatmats0 -
Site Content Review Please!
I m looking for someone who can review my site and let me about quality of content on my site. Can anyone suggest / know who I can talk to about this ? Nick
Content Development | | orion680 -
How can i solve duplicate problem with different url needed?
My client is a big international firm with 10 websites with different url (.co.uk, .com, .com.au, .pl... etc). All websites are exactly the same except the price. I suggested them to only use .com and use region as a sub domain like au.xxx.com instead of xxx.com.au. However they cannot do that for some reason. I am trying to solve the duplicate issue. I dont think i can use 301 redirect or canonial link because all regions are making even traffics. Any suggestions?
Content Development | | ringochan0 -
I have created 2 blogs for a client as they have 2 domains (1 for their core business, and 1 for a product). I want to use the same content on both blogs. What is the best way to set this up so there are no ranking or duplicate content issues?
We are pushing SEO for only one of the domains, therefore I would like one to be dominant. We will be sending the blog post via email to their database, therefore each blog needs to have the same content. Thank you!
Content Development | | MarketingResults0 -
Content Writers / Blog Posts
Hi there Would anyone know where i could fund affordable, reliable blog post writers who would be able to produce quality posts at affordable rates? What would the accepted rate be etc? Regards Stef
Content Development | | stefanok0 -
Getting Duplicated Content Removed
So I recently took over an in-house SEO role and began some house cleaning. I found a few places that had copied or duplicated our homepage content. Naturally I reached out to them to ask them to remove or change the content. Today I come to the office and one of the sites I had requested to remove the content, had fired back at me that I was being rude, threatening and I should go f**k myself. As if this wasn't enough this guys was an upper level manager (managing director) and knows the upper management where I work. Now I have people in my company pissed at me, when I thought I was doing the right thing. Am I in the wrong or what? I had simply asked to remove or change the content and that failure to do so could result in legal action. I understand that it could have been misconstrued as a threat (which it wasn't intended to be) but its seems like a pretty immature response from a higher level person. Any thoughts or advice on what to do next?
Content Development | | Gerad0