Duplicate content - what to do?
-
Hi,
We have a whole lot of articles on our site. In total 5232 actually.
The web crawler tells me that in the articles we have a lot of duplicate content. Which is sort of nonsense, since each article is unique. Ah, some might have some common paragraphs because they are recurring news about a weekly competition.
But, an example:
http://www.betxpert.com/artikler/bookmakere/brandvarme-ailton-snupper-topscorerprisen
AND
http://www.betxpert.com/artikler/bookmakere/opdaterede-odds-pa-sportschef-situationen-pa-vestegnen
These are "duplicate content", however the two article texts are not the same. The menu, and the widgets are all the same, but highly relevant to the article.
So what should I do? How can i rid myself of these errors?
-Rasmus
-
So! Have now made some changes.
I have removed the large number of links at the bottom and a single widget on the right. It seems to have lowerede the level of noise on the page.
We brandish our articles with keywords (but mostly new ones since the feature is new) such that only relevant articles are linked (in a widget which appears when relevant articles are found).
This change should cut it, right?
-Rasmus
-
Rasmus,
Your description and keywords tags are exactly the same on both pages.
The description should be a summary of the content of each individual page
If you fix that, it may go some way towards fixing the problem.
If that doesn't help, then consider adding more text to those stories
- say a little more about each competitor, or at least the leader or the top 3.
Another thing you could consider is using a different template for that type of page, so you don't add all that stuff under the HR tag, and maybe drop off something from the right column, so the page is a little bit shorter and the story will be a larger percentage of the text.
You also have a lot of inline javascript and a lot of external javascripts.
I don't know if the bots or the ranking algorithms care, but it would be a lot nicer if you consolidated some of that.
-
Hey Rasmus,
The menu, widgets e.t.c all count as part of content as they are page elements, so ofcourse they would be considered.
This situation is abit tricky, however if you think you can merge them do so, maybe add slightly more content to each page; otherwise do nothing.
Just make sure and see whether both pages are ranking for the appropriate keywords.
Thanks,
Vahe
-
That is almost duplicate content. The % of the unique content on the two pages you've posted as example is small - only the actual content is different - the rest of the site wide boxes and boiler plates are the same.
So matematicly the difference in those two pages is very small.
The good thing is that you have the article in a good real estate location on the page - amnd that is good.
If your "score" as far as page views, Bounce rate, time on page, loyality is good then no need to worry about the crawler telling you about the duplicate issue. if the Bounce rate, time on page etc doesn't look good then yes, you nee dot worry about it.
My suggestion will be to cut out some or most of the boiler plate boxes in your site structure - it doesn't help you, it doesn't help your readers but it dose harm you with all those links per page as far as number (% of links vs text) and to be honest I am not 100% sure it helps your users with that aggressive approach: a lot of options.
Also there is a good approach not to use the same target for the link in the article as it doesn't counts - only the first one is taken in consideration as far as anchor text - as far as seo. If it has a good CTR then keep it but remember that even if only one counts as sending SEO signal (anchor text and link love) it dose count as far as number of links per page.
The bottom line is that if you cut about 50% of the boiler plates in those pages you will gain a lot of advantages for both the SEO side and you would also help your users (usability, navigation etc).
You don't have to take my advice for granted - do this for some of the articles and monitor ctr, serps for them and so on to see the improvements.
Hope it helps. If it didn't hopefully someone else will also post an opinion
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Exclude sorting options using nofollow to reduce duplicate content
I'm getting reports of duplicate content for pages that have different sorting options applied, e.g: /trips/dest/africa-and-middle-east/
On-Page Optimization | | benbrowning
/trips/dest/africa-and-middle-east/?sort=title&direction=asc&page=1
/trips/dest/africa-and-middle-east/?sort=title&direction=des&page=1 I have the added complication of having pagination combined with these sorting options. I also don't have the option of a view all page. I'm considering adding rel="nofollow" to the sorting controls so they are just taken out of the equation, then using rel="next" and rel="prev" to handle the pagination as per Google recommendations(using the default sorting options). Has anyone tried this approach, or have an opinion on whether it would work?0 -
Duplicated content by the product pages
Hi,Do you thing those pages have duplicate content:https://www.nobelcom.com/Afghanistan-phone-cards/from-Romania-235-2.htmlhttps://www.nobelcom.com/Afghanistan-phone-cards-2.htmlhttps://www.nobelcom.com/Afghanistan-Cell-phone-cards-401.htmlhttps://www.nobelcom.com/Afghanistan-Cell-phone-cards/from-Romania-235-401.html.And also how much impact will it have on a panda update?I'm trying to figure out if all the product pages, (that are in the same way as the ones above) are the reson for a Panda Penalty
On-Page Optimization | | Silviu0 -
Duplicate Content - But it isn't!
Hi All, I have a site that releases alerts for particular problem/events/happenings. Due to legal stuff we keep the majority of the content the same on each of these event pages. The URLs are all different but it keeps coming back as duplicate content. The canonical tag is not right (i dont think for this) egs http://www.holidaytravelwatch.com/alerts/call-to-arms/egypt/coral-sea-waterworld-resort-sharm-el-sheikh-egypt-holiday-complaints-july-2014 http://www.holidaytravelwatch.com/alerts/call-to-arms/egypt/hotel-concorde-el-salam-sharm-el-sheikh-egypt-holiday-complaints-may-2014
On-Page Optimization | | Astute-Media0 -
Nice looking ecommerce menus with featured product categories - bad for SEO due to duplicate content?
My ecommerce website has menus which contain 'featured product sub-categories'. These are shown alongside the other product sub-category links. Each 'featured product category' includes a link, an image (with link) and some text. All menu content is visible to search engines. These menus look nice and probably encourage CTR (not tested!) but are they bad for SEO?
On-Page Optimization | | Coraltoes771 -
Duplicate content harms individual pages or whole site?
Hi, One section of my site is a selection of Art and Design books. I have about 200 individual posts, each with a book image and a description retrieved from Amazon (using their API). Due to several reasons not worth mentioning I decided to use the Amazon description. I don't mind if those pages rank well or not, but I need them as additional content for my visitors as they browse my site. The value relies in the selection of books. My question is if the duplicate content taken from Amazon harms only each book page or the whole site. The rest of the site has unique content. Thanks! Enrique
On-Page Optimization | | enriquef0 -
Prevent indexing of dynamic content
Hi folks! I discovered bit of an issue with a client's site. Primarily, the site consists of static html pages, however, within one page (a car photo gallery), a line of php coding: dynamically generates a 100 or so pages comprising the photo gallery - all with the same page title and meta description. The photo gallery script resides in the /gallery folder, which I attempted to block via robots.txt - to no avail. My next step will be to include a: within the head section of the html page, but I am wondering if this will stop the bots dead in their tracks or will they still be able to pick-up on the pages generated by the call to the php script residing a bit further down on the page? Dino
On-Page Optimization | | SCW0 -
Duplicate Links
Hello, I am entering sitewide navigation that will go to primary seo pages. This is really for usability, not for link juice. I'm wondering if I should still link to these very important pages in my index page's content. Or if I should consider those navigation links strong enough. If I did link in the content, then I would have more than one link to the same page on my home page. Thanks Tyler
On-Page Optimization | | tylerfraser0 -
Cross Domain Duplicate Content
Hi My client has a series of websies, one main website and several mini websites, articles are created and published daily and weekly, one will go on a the main website and the others on one, two, or three of the mini sites. To combat duplication, i only ever allow one article to be indexed (apply noindex to articles that i don't wanted indexed by google, so, if 3 sites have same article, 2 sites will have noindex tag added to head). I am not completely sure if this is ok, and whether there are any negative affects, apart from the articles tagged as noindex not being indexed. Are there any obvious issues? I am aware of the canonical link rel tag, and know that this can be used on the same domain, but can it be used cross domain, in place of the noindex tag? If so, is it exactly the same in structure as the 'same domain' canonical link rel tag? Thanks Matt
On-Page Optimization | | mattys0