Duplicate Content Question
-
Just signed up for pro and did my first diagnostic check - I came back with something like 300 duplicate content errors which suprised me because every page is unique.
Turns out my pages are listed as www.sportstvjobs.com and just sportstvjobs.com does that really count as duplicate? and if so does anyone know what I should be doing differently?
I thought it was just a canonical issue, but best I can tell I have the canonical in there but this still came up as a duplicate error....maybe I did canonical wrong, or its some other issue?
Thanks
Brian Clapp
-
You want them on all pages as I'm sure Google is seeing copies of all your pages. This is really a best practices thing but I add them to all pages when the page is created to avoid just such issues. If you choose the www version you would use this tag for the Career center page:
In addition I've added a link to this great post on canonical
Hope this helps
-
its pretty awesome. Welcome
-
less than 24 hours into my seomoz pro membership and I'm already blown away - thanks for all of your assistance. Christine it appears I don't have a .htaccess file so I will follow what you wrote and create a new blank file with just that code in it...
you guys rock. I've got lots more learning to do....
Brian
-
Something that was challenging for me at first was finding .htaccess file. It should be in the root directory of where all of you website files are stored. It may be hidden or you may need to create one. If its hidden, find out how to un-hide files in your specific FTP program. If you need to create it, simply create a blank file with the name .htaccess and paste the recommendation that Ryan made.
-
Ryan thanks for your great advice. I'm the site founder but by no means a tech expert... I'm more the content guy, but I'm learning. I
understand what you have written...all except the part of where I put that code. Where do I find my .htaccess file?
-
Thank you for your great response Dave! I'm the founder of the site, but my background is more in content and I'm learning the SEO as I go, so forgive me if this is a silly follow up.
In reference to response #4 - my original designer said canonical was only on the home page, but your response sounds like it should be on every page? If so do I put the whole url for that page, or just the root? Again not an expert here so all this advice really helps me learn.
Thanks
Brian
-
- In addition to your 301 redirect issue Ryan mentioned you are internally linking to the non www version for your logo link: (this leaks juice on the redirect as well if you are going for the www version)
2 ) You really want to choose one version and go with it everywhere (be precise down to the trailing slash) - Google webmaster tools has a setting for this as well - sign up and choose your preferred setting / then save if you haven't already
-
Make the changes and check Open Site Explorer for both versions to see your links that appear the non-preferred way and see if you can contact your external linking sources to fix the issue to the preferred URL
-
I didn't see any canonical for the other pages (other than the home page) add those as well
-
Rerun OSE after your next crawl completes or use Xenu for immediate testing for the internal links - external may take a bit longer.
-
This matters mainly because of the potential for link dilution - most people agree you won't be explicitly penalized. See http://www.herseo.com/blog/2009/05/30/how-important-is-it-to-htaccess-redirect-to-www/
The best way to address this is to set up a 301 redirect in your .htaccess file. I recently did this for my own domain with the following code:
<ifmodule mod_rewrite.c="">RewriteEngine on
# Redirect adoptionhelp.org to www.adoptionhelp.org
RewriteCond %{HTTP_HOST} !^www.adoptionhelp.org [NC]
RewriteRule ^(.*)$ http://www.adoptionhelp.org/$1 [R=301,L]</ifmodule>Add that to your .htaccess file and drop it in your root directory.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Email and landing page duplicate content issue?
Hi Mozers, my question is, if there is a web based email that goes to subscribers, then if they click on a link it lands on a Wordpress page with very similar content, will Google penalize us for duplicate content? If so is the best workaround to make the email no index no follow? Thanks!
Technical SEO | | CalamityJane770 -
Simple duplicate content query
Hello Community, One of my clients runs a job board website. They are having some new framework installed which will lead to them having to delete all their jobs and re-add them. The same jobs will be re-posted but with a different reference number which in turn with change each URL. I believe this will cause significant duplicate content issues, I just thought I would get a second opinion on best practice for approaching a situation like this. Would a possible solution be to delete jobs gradually and 301 re-direct old URLs to new URLs? Many thanks in advance, Adam
Technical SEO | | SO_UK0 -
Duplicate Page Content but where?
Hi All Moz is telling me I have duplicate page content and sure enough the PA MR mT are all 0 but it doesnt give me a link to this content! This is the page: http://www.orsgroup.com/index.php?page=Scanning-services But I cant find where the duplicate content is other than on our own youtube page which I will get removed here: http://www.youtube.com/watch?v=Pnjh9jkAWuA Can anyone help please? Andy
Technical SEO | | ORS-Group0 -
Container Page/Content Page Duplicate Content
My client has a container page on their website, they are using SiteFinity, so it is called a "group page", in which individual pages appear and can be scrolled through. When link are followed, they first lead to the group page URL, in which the first content page is shown. However, when navigating through the content pages, the URL changes. When navigating BACK to the first content page, the URL is that for the content page, but it appears to indexers as a duplicate of the group page, that is, the URL that appeared when first linking to the group page. The client updates this on the regular, so I need to find a solution that will allow them to add more pages, the new one always becoming the top page, without requiring extra coding. For instance, I had considered integrating REL=NEXT and REL=PREV, but they aren't going to keep that up to date.
Technical SEO | | SpokeHQ1 -
Fix duplicate content caused by tags
Hi everyone, TGIF. We are getting hundreds of duplicate content errors on our WP site by what appears to be our tags. For each tag and each post we are seeing a duplicate content error. I thought I had this fixed but apparently I do not. We are using the Genesis theme with Yoast's SEO plugin. Does anyone have the solution to what I imagine is this easy fix? Thanks in advance.
Technical SEO | | okuma0 -
Duplicate Content Issue
Hi Everyone, I ran into a problem I didn't know I had (Thanks to the seomoz tool) regarding duplicate content. my site is oxford ms homes.net and when I built the site, the web developer used php to build it. After he was done I saw that the URL's looking like this "/blake_listings.php?page=0" and I wanted them like this "/blakes-listings" He changed them with no problem and he did the same with all 300 pages or so that I have on the site. I just found using the crawl diagnostics tool that I have like 3,000 duplicate content issues. Is there an easy fix to this at all or does he have to go in and 301 Redirect EVERY SINGLE URL? Thanks for any help you can give.
Technical SEO | | blake-766240 -
Aspx filters causing duplicate content issues
A client has a url which is duplicated by filters on the page, for example: - http://www.example.co.uk/Home/example.aspx is duplicated by http://www.example.co.uk/Home/example.aspx?filter=3 The client is moving to a new website later this year and is using an out-of-date Kentico CMS which would need some development doing to it in order to enable implementation of rel canonical tags in the header, I don't have access to the server and they have to pay through the nose everytime they want the slightest thing altering. I am trying to resolve this duplicate content issue though and am wondering what is the best way to resolve it in the short term. The client is happy to remove the filter links from the page but that still leaves the filter urls in Google. I am concerned that a 301 redirect will cause a loop and don't understand the behaviour of this type of code enough. I hope this makes sense, any advice appreciated.
Technical SEO | | travelinnovations0 -
The Bible and Duplicate Content
We have our complete set of scriptures online, including the Bible at http://lds.org/scriptures. Users can browse to any of the volumes of scriptures. We've improved the user experience by allowing users to link to specific verses in context which will scroll to and highlight the linked verse. However, this creates a significant amount of duplicate content. For example, these links: http://lds.org/scriptures/nt/james/1.5 http://lds.org/scriptures/nt/james/1.5-10 http://lds.org/scriptures/nt/james/1 All of those will link to the same chapter in the book of James, yet the first two will highlight the verse 5 and verses 5-10 respectively. This is a good user experience because in other sections of our site and on blogs throughout the world webmasters link to specific verses so the reader can see the verse in context of the rest of the chapter. Another bible site has separate html pages for each verse individually and tends to outrank us because of this (and possibly some other reasons) for long tail chapter/verse queries. However, our tests indicated that the current version is preferred by users. We have a sitemap ready to publish which includes a URL for every chapter/verse. We hope this will improve indexing of some of the more popular verses. However, Googlebot is going to see some duplicate content as it crawls that sitemap! So the question is: is the sitemap a good idea realizing that we can't revert back to including each chapter/verse on its own unique page? We are also going to recommend that we create unique titles for each of the verses and pass a portion of the text from the verse into the meta description. Will this perhaps be enough to satisfy Googlebot that the pages are in fact unique? They certainly are from a user perspective. Thanks all for taking the time!
Technical SEO | | LDS-SEO0