Duplicate Page and Title Issues
-
On the last crawl, we received errors for duplicate page titles and some duplicate content pages.
Here is the issue:
We went through our page titles that were marked as duplicate and changed them to make sure their titles were different. However, we just received a new crawl this week and it is saying there are even more duplicate page title errors detected than before. We're wondering if this is a problem with just us or if it has been happening to other Moz users.
As for the duplicate content pages, what is the best way to approach this and see what content is being looked at as a "duplicate" set?
-
I am being told I have hundreds of duplicate titles and content on my site. It's not possible. Not only do I only have 120ish posts on my site and they all have different titles, but google console shows me that no on on the web is claiming my posts as theirs (ie they are not saying they are the originals, etc.) So what the heck is the issue? Why am I being told that posts that are NOT duplicate of anything are duplicate content and that I have a bunch of duplicate titles when NONE OF MY titles are duplicates of any other title?????????
And, how can I have 400 pieces of duplicate content when I only have 120 blog posts??
Please someone help me with this
-
Always glad to help!
-
Thank you for your help!
-
Hi there!
I took a look at your campaign and it seems that we crawled a lot more page of the site this week in general than we did the previous week. Two weeks ago, we crawled about 500 pages and this week the crawl jumped up to 2800. So it isn't that there are more duplicate pages on your site now, it is just that we are able to crawl more pages now than we were before, which led to us finding even more duplicate pages that had not been reported before.
As for why we are crawling so many more pages, it could be for a few reasons. If you made changes to the links on your site, the page hierarchy of the site, or if you remove noindex tags or updated the robots.txt file for the site, those things could all affect how we are able to crawl the site.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
Help Team Sensei -
Hey There!
I responded to your support request with more information on how we view canonicals. I hope it was helpful!
If you can send me examples of pages that you believe are being counted incorrectly, that will help me determine if there is an issue with the crawl or if the pages correctly fall into how we determine duplicates based on the canonical tags.
I look forward to hearing back from you there soon!
Chiaryn
Help Team Sensei -
They have different purposes, but all relating to preventing the same page from showing duplicate content because of the different ways a URL can be written. There is nothing on this page to show that using a canonical tag can take two different pages and remove the similar content. The purpose of the canonical tag is to set the preferred URL for one page.
-
The problem is, our content is unique to each page and post. Yet they still have been coming up duplicated. I'll have to try Netrepid's google searching suggestion to double check these.
-
I would remove the domain name when you use the query.
moz keyword research in the united states best practice gets a much different SERP than keyword research in the united states best practice.
If you are trying to get a pure SERP result than you shouldn't use your domain name. That will tell you if there are any other search results in the web. If you want to find duplicate content on your site use copyscape.com or go to GWT and look for internal duplicate content.
Again, not only copy creates a duplicate content message. It is having an off html to text ratio, repetitive links in the HTML with not enough copy to balance it out. If Moz is reading a duplicate content error, and the number is increasing week to week I wouldn't discredit the finding simply because you don't understand why the error is occurring. The canonical tag won't prevent two different URLs from showing duplicate content. If you want to do that, no follow one of the URLs. That isn't best practice though, best practice is to fix the copy.
-
Hey Monica... canonical tagging can be used for a lot more than just 'www' or non-www:
-
Yeh, the weird thing I am noticing is that the canonical tags are already present on this domain, and it's not picking up ALL of the pages with canonical as duplicates.
I'm not really sure what's going on, but when in doubt, I always Google the following query:
site:domain intext:block of text unique to that page
If there is a duplicate content issue, Google should tell you that by showing more than one result. If it shows only one, then Google is reading your code right.
I know we all love Moz and want them to show we have no errors on our sites, but at the end of the day... don't we really want Google to find no issues with our sites, not Moz?
-
Canonical tags just point non www URL address to www addresses. It tells the engines that whether or not the WWW is used, the two URLs are the same page. It will only solve the duplicate content errors if that is in fact what is causing the error. If the actual cause is duplicate content the only way to solve it is to write unique copy.
-
Thank you for that information!
-
No Magento. We were debating the use of Canonical tags ourself.
-
I'm noticing a similar issue for an online store I consult for. We added canonical tags to all product pages and category pages, and Moz doesn't appear to be correctly attributing them.
Are you using a Magento store by chance?
-
Depending on when you made the changes, it could just be that they weren't fixed in time for the next crawl. Fixing these duplicate titles are really important for your SEO.
Open the medium priority issues and set it to duplicate page titles only. When you do that you will see which titles are duplicate. Sometimes there are more than one duplicate title so make sure you completely expand each line. I would make sure I go back into all of them and see if what is showing as duplicate on the crawl report is still the same information on your title tags. If it matches, then those pages need to be changed. If the titles are different, then wait another week and just see if the timing was off somehow.
If you have pages with duplicate content there could be a few things triggering it. There could be a too much of the same HTML and not enough text to make the pages look different. The content on the pages could be very thin, and very similar. The best way to offset duplicate page errors on your site is to get original, informative, unique content on those pages. You can set your crawl report to high priority errors, then select duplicate page content. You can then look at all of the duplicate pages side by side to determine if you can get unique content on those pages. If you are getting duplicate page errors for the same web page, one with a WWW and one without, then check to make sure your REL Canonical tags are in place and functioning properly. If the pages are different then you need to get great content up.
-
Hi there,
See here - I think Moz Analytics/PRO don't process rel=prev/next properly, so they may give false alarms on those pages, even if the titles are properly implemented.
Cheers
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Pro: Redirect Chain warning given to pages that don't have redirects
When I look up crawl errors for a page, I'm always told the page suffers from redirect chaining. However, when I do a redirect check (in this case, using the Redirect Path Chrome extension), it indicates that my page does not use a redirect. Why would Moz detect redirects, while no other redirect checker resource does? For example, this URL gets Moz's redirect chain warning: https://www.aem.org/news/january-2018/5-reasons-iot-projects-fail/ But there is no redirect associated with this URL.
Moz Bar | | jrichter0 -
Duplicate content found in scan
On June 8th we ran a Moz Crawl on our site. We found 144 pages that were flagged with duplicate content.
Moz Bar | | StickyLife
Again on June 13th we ran another moz crawl on our site and found 137 pages that were flagged with duplicate content. Then one final scan on June 22nd with 161 pages of duplicate content. After comparing the 3 different scans I see that, without making any changes, pages that were not flagged as duplicate content are now being flagged as duplicate content. While at the same time, pages that were originally flagged as duplicate content are now no longer showing up with duplicate content. I could understand if we made some changes to these pages but no changes were made. For example: On the 8th this page was flagged as duplicate content - https://www.stickylife.com/star-magnet
On the 13th and 22nd it was not flagged as duplicate content but no changes were made to that page. For reference it was flagged as duplicate content with the following page: https://www.stickylife.com/baseball-glove-magnet This page was also Not changed or altered between between these dates. In addition, when Moz scans our site through our campaign every Friday the results do not match what we see when we do a manual scan. Moz's weekly scan only reveals 14 pages with duplicate content as opposed to the numbers you see above. Why such inconsistencies in the Moz Scans?0 -
Issues with Crawl Test and SSL Certificate
So I have having issues with the Crawl Test being able to crawl my site accurately due to what the tool is saying is a "SSL Certificate Error" (804 : HTTPS (SSL) error encountered when requesting page.) Only thing is that I have no warnings about this SSL issue in Search Console and when I check the SSL on https://www.sslshopper.com it comes back just fine. Anybody know why this might be happening or have encountered this issue before?
Moz Bar | | DRSearchEngOpt0 -
On-Page Grader "Sorry, but that URL is inaccessible."
We have a new client with a squarespace page. http://www.mountainhouseestate.com The Moz On-Page grader returns the error "Sorry, but that URL is inaccessible." for all pages. Possibly related, Google seems to hate their site. Even a search for "mountain house estate" returns lousy results. Bing/Yahoo has no problem with it.
Moz Bar | | Duke_Ferris1 -
How Does the On-Page Grader Know about my Target Keyword? Or how can I tell it?
So we've optimized a home page for a particular keyword, "blue widgets tx". But the on-page grader is giving information about "tx blue widgets", "blue widgets in texas", etc. and telling us we are an "F" for these keywords. Is it possible to tell the on-page grader, "Hey, just worry about 'blue widgets tx', and forget about those other ones"? I know I can do it by hand, but it will take forever.
Moz Bar | | Titan5520 -
Domain.com isn't recognized by on-page-grader, but domain.com/index.php is
I am running a website through On-page-grader, as www.domain.com and scores an "F" for a specific keyword. When it's ran as www.domain.com/index.php, it scores an "A" for that same keyword and has everything checked other than "keyword in the domain name". There are no other files such as index.htm, or index.html that would interfere and can't figure out why this page is not being recognized. I checked, the robots and .htaccess file, but do not see anything that would hinder. Could this be a server issue?
Moz Bar | | werkbot0 -
Crwal errors : duplicate content even with canonical links
Hi I am getting some errors for duplicate content errors in my crawl report for some of our products www.....com/brand/productname1.html www.....com/section/productname1.html www.....com/productname1.html we have canonical in the header for all three pages <link rel="canonical" href="www....com productname1.html"=""></link rel="canonical" href="www....com>
Moz Bar | | phes0 -
Duplicate content - Which is the other duplicate page?
Hi I just ran a campaign, and I got a duplicate content warning for some of my pages. When I go into the diagnostic report, I am unable to find the page detected by google as 'duplicate' to the main page. Unless I know which 2 pages are being detected as duplicate, it'll be really difficult to actually solve the problem. Would be great to have any kind of help here. Thanks in advance!
Moz Bar | | rjchugh0