I have a duplicate content on my Moz crawler, but google hasn't indexed those pages: do I still need to get rid of the tags?
-
I received an urgent error from the Moz crawler that I have duplicate content on my site due to the tags I have. For example:
http://www.1forjustice.com/graves-amendment/
The real article found here: http://www.1forjustice.com/car-accident-rental-car/
I didn't think this was a big deal, because when I looked at my GWT these pages weren't indexed (picture attached).
Question: should I bother fixing this from an SEO perspective? If Google isn't indexing the pages, then am I losing link juice?
-
It will fully depend on the purpose of each page. In the example case you mentioned, that will be the best solution, but canonical tags =/= noindex tags. I would only suggest using canonical tags if there's a large amount of similar content between pages.
For noindex, I generally don't use them unless I specifically don't want a certain page to be indexed (highly-targeted PPC landing pages are a good example) - you usually don't want to deindex pages without a reason/goal.
If there's lots of duplicate content issues on your site, here are two possible options for cleaning them up, from most ideal to least:
- Identify duplicate pages and revise the content itself so that it's sufficiently unique. Remove all noindex and canonical tags unless they were already in place for another reason.
- Use canonical tags to consolidate two or more pages. This will essentially act as a 301 redirect while still allowing users to view the canonicalized pages if they come across them. Your 'best' page of the group shouldn't have any canonical tag on it. This approach should only be used for duplicate content-related issues, not as a substitute for proper redirects if that's what the situation calls for.
Either way, I would remove the noindex tags from your pages unless they were specifically put there for a reason. If you've noticed a bunch, make sure there isn't a toggle or checkbox in you CMS' admin panel that is adding it by default to new pages.
Good luck!
-
Excellent! Thank you, so do I have to go through and add a canonical tags to all of the tagged pages? Sounds like it will take a while, but it also sounds like I don't have many choices.
-
You should be relatively safe from duplicate content issues at the moment, however you're leaving some 'link juice' on the table since whatever equity is in the noindexed page is remaining with it.
If you want to consolidate the pages from a search engine point of view, but still have them both accessible on your site, then you should remove the noindex from the page and add a canonical tag on the less-important page (pointing to the other page). The more important page won't need any additional tags.
The page with the canonical tag won't be accessible from search engines if you do this, so another route is to develop the content on each page a bit more so that they're more dissimilar; you wouldn't need any tags in this case.
-
Excellent response. So would I go through and add the canonical tag to all tag pages?
This duplicate content won't hurt my site because those pages aren't indexed right?
-
I'm not sure if I understand the question, but the reason the Graves Amendment page isn't being indexed isn't due to duplicate content, it's because of the meta noindex tag on there:
Removing that from the page should get it indexed. If the pages have very similar copy, with slight nuances, I would use a canonical tag to consolidate all of the equity into the 'primary' page to help avoid any duplicate content issues. Hope that helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate Page
I just Check Crawl the status error with Duplicate Page Content. As Mentioned Below. Songs.pk | Download free mp3, Hindi Music, Indian Mp3 Songs http://www.getmp3songspk.com Songs.pk | Download free mp3, Hindi Music, Indian Mp3 Songs http://getmp3songspk.com and then i added these lines to my htaccess file RewriteBase /
Moz Pro | | Getmp3songspk
RewriteCond %{HTTP_HOST} !^www.getmp3songspk.com$ [NC]
RewriteRule ^(.*)$ http://www.getmp3songspk.com/$1 [L,R=301] But Still See that error again when i crawl a new test.0 -
Possible Crawling Problem with Screaming Frog and Moz Crawlers
So I'm not sure if what I'm seeing is a problem or not. As of about two weeks ago the Moz crawler has only been able to see www.mysite.com, and none of the links, content, title, ect associated with the page. Essentially the report has one line, what should be the homepage, but it's not able to pull any information from the page but does show a 200 http status code. The report shows nothing blocked by robots or any errors. When I use screaming frog to crawl the site about 75% of the time it just reports one line www.mysite.com with a 200 status code, but again the crawler is not able to actually see the html. The other 25% of the time it works perfectly fine, crawls all pages and sees all meta info and content. There are no errors in Google WMT and everything looks ok there. We have seen a traffic drop the last two weeks but I don't know if this is the reason for it. I can't publicly post the page but if someone has an idea of what might be going on I'd be happy to PM them. Thanks
Moz Pro | | CJ50 -
Duplicate Titles Shown in Moz Analytics
Hello, My Moz analytics show over 50 duplicate titles. This because my website title is shown on each page (eg About us | Social Engagement, Contact us | Social Engagement, etc.) Is this really an error to be fixed, that otherwise will impact rankings? Or can I leave it as it is? I don't mind having my website title on each page, but if its worth removing it due to duplicate issues impacting ranking, I will remove 🙂 In this case, does someone have any suggestion on how to do this? Which files should I modify? (Im using Wordpress CMS, and I dont see each page code) Thanks in advance.
Moz Pro | | socialengaged
Regards, Eugenio | Social Engagement (http://socialengagement.it)0 -
Howcome my target country (Kuwait) don't appear while im trying to create a campaign? www.google.com.kw.
im in kuwait and already getting good results in the local google search engine, but howcome you dont have my local search engine in your country list www.google.com.kw when using your rank tracking tool thank you PGFHRAlGu
Moz Pro | | WeKnowDigital0 -
Is there a report I can run to get a list of all pages indexed by Google for my website?
I want to get a CSV file of all the pages that are indexed by Google and other search engines so I can create and .htaccess file of 301 redirects
Moz Pro | | etraction0 -
How to remove /index.html that causes duplicated content
Hi, How to remove /index.html that causes duplicated content?
Moz Pro | | whitelies
From my website navigation links, it does not shows the /index.html. However, when I run the seomoz crawl errors, it show duplicated content. Can anyone tell me how to do it?0 -
SEOmoz crawler and duplicate content
Does anybody know if the SEOmoz crawler picks up canonical tags when its looking for duplicate content? I've got a ton of errors in one of my projects even though they all have canonical tags. Thanks!
Moz Pro | | neooptic0