Duplicate Page and Title Issues
-
On the last crawl, we received errors for duplicate page titles and some duplicate content pages.
Here is the issue:
We went through our page titles that were marked as duplicate and changed them to make sure their titles were different. However, we just received a new crawl this week and it is saying there are even more duplicate page title errors detected than before. We're wondering if this is a problem with just us or if it has been happening to other Moz users.
As for the duplicate content pages, what is the best way to approach this and see what content is being looked at as a "duplicate" set?
-
I am being told I have hundreds of duplicate titles and content on my site. It's not possible. Not only do I only have 120ish posts on my site and they all have different titles, but google console shows me that no on on the web is claiming my posts as theirs (ie they are not saying they are the originals, etc.) So what the heck is the issue? Why am I being told that posts that are NOT duplicate of anything are duplicate content and that I have a bunch of duplicate titles when NONE OF MY titles are duplicates of any other title?????????
And, how can I have 400 pieces of duplicate content when I only have 120 blog posts??
Please someone help me with this
-
Always glad to help!
-
Thank you for your help!
-
Hi there!
I took a look at your campaign and it seems that we crawled a lot more page of the site this week in general than we did the previous week. Two weeks ago, we crawled about 500 pages and this week the crawl jumped up to 2800. So it isn't that there are more duplicate pages on your site now, it is just that we are able to crawl more pages now than we were before, which led to us finding even more duplicate pages that had not been reported before.
As for why we are crawling so many more pages, it could be for a few reasons. If you made changes to the links on your site, the page hierarchy of the site, or if you remove noindex tags or updated the robots.txt file for the site, those things could all affect how we are able to crawl the site.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
Help Team Sensei -
Hey There!
I responded to your support request with more information on how we view canonicals. I hope it was helpful!
If you can send me examples of pages that you believe are being counted incorrectly, that will help me determine if there is an issue with the crawl or if the pages correctly fall into how we determine duplicates based on the canonical tags.
I look forward to hearing back from you there soon!
Chiaryn
Help Team Sensei -
They have different purposes, but all relating to preventing the same page from showing duplicate content because of the different ways a URL can be written. There is nothing on this page to show that using a canonical tag can take two different pages and remove the similar content. The purpose of the canonical tag is to set the preferred URL for one page.
-
The problem is, our content is unique to each page and post. Yet they still have been coming up duplicated. I'll have to try Netrepid's google searching suggestion to double check these.
-
I would remove the domain name when you use the query.
moz keyword research in the united states best practice gets a much different SERP than keyword research in the united states best practice.
If you are trying to get a pure SERP result than you shouldn't use your domain name. That will tell you if there are any other search results in the web. If you want to find duplicate content on your site use copyscape.com or go to GWT and look for internal duplicate content.
Again, not only copy creates a duplicate content message. It is having an off html to text ratio, repetitive links in the HTML with not enough copy to balance it out. If Moz is reading a duplicate content error, and the number is increasing week to week I wouldn't discredit the finding simply because you don't understand why the error is occurring. The canonical tag won't prevent two different URLs from showing duplicate content. If you want to do that, no follow one of the URLs. That isn't best practice though, best practice is to fix the copy.
-
Hey Monica... canonical tagging can be used for a lot more than just 'www' or non-www:
-
Yeh, the weird thing I am noticing is that the canonical tags are already present on this domain, and it's not picking up ALL of the pages with canonical as duplicates.
I'm not really sure what's going on, but when in doubt, I always Google the following query:
site:domain intext:block of text unique to that page
If there is a duplicate content issue, Google should tell you that by showing more than one result. If it shows only one, then Google is reading your code right.
I know we all love Moz and want them to show we have no errors on our sites, but at the end of the day... don't we really want Google to find no issues with our sites, not Moz?
-
Canonical tags just point non www URL address to www addresses. It tells the engines that whether or not the WWW is used, the two URLs are the same page. It will only solve the duplicate content errors if that is in fact what is causing the error. If the actual cause is duplicate content the only way to solve it is to write unique copy.
-
Thank you for that information!
-
No Magento. We were debating the use of Canonical tags ourself.
-
I'm noticing a similar issue for an online store I consult for. We added canonical tags to all product pages and category pages, and Moz doesn't appear to be correctly attributing them.
Are you using a Magento store by chance?
-
Depending on when you made the changes, it could just be that they weren't fixed in time for the next crawl. Fixing these duplicate titles are really important for your SEO.
Open the medium priority issues and set it to duplicate page titles only. When you do that you will see which titles are duplicate. Sometimes there are more than one duplicate title so make sure you completely expand each line. I would make sure I go back into all of them and see if what is showing as duplicate on the crawl report is still the same information on your title tags. If it matches, then those pages need to be changed. If the titles are different, then wait another week and just see if the timing was off somehow.
If you have pages with duplicate content there could be a few things triggering it. There could be a too much of the same HTML and not enough text to make the pages look different. The content on the pages could be very thin, and very similar. The best way to offset duplicate page errors on your site is to get original, informative, unique content on those pages. You can set your crawl report to high priority errors, then select duplicate page content. You can then look at all of the duplicate pages side by side to determine if you can get unique content on those pages. If you are getting duplicate page errors for the same web page, one with a WWW and one without, then check to make sure your REL Canonical tags are in place and functioning properly. If the pages are different then you need to get great content up.
-
Hi there,
See here - I think Moz Analytics/PRO don't process rel=prev/next properly, so they may give false alarms on those pages, even if the titles are properly implemented.
Cheers
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
"New" issues not previously found being shown?
I'm not sure what logic Moz is using for its reporting of Site Crawl issues, but it appears to be pretty flawed (unless I'm missing something, which is possible). I've got a client site that has been in Moz for about 6 months now. Every time the crawler runs, the same number of pages are reported as having been crawled. However I'm consistently getting "New Issues" reported that should have been reported during previous crawls. Example: A redirect chain was reported several month ago. The referring URL was the homepage of the website, and we tracked it down to an old link in the header. This was fixed, marked as resolved, and the issue was not shown on the next crawl. Several weeks later, the same issue was reported for a different page on the website - a page which has existed since 2014 and was already crawled many times. Again, we fixed. Fast-forward to the report that just ran on 12/1 and we have the same issue reported, for a different page, which has also existed for years and has been previously crawled. It's very hard to explain to a client "this item you are seeing has been resolved", only to have it continually crop back up in future reports. Note this is not limited to redirect chains - that's just an example. I'm seeing this for other items such as missing canonicals, duplicate titles, etc.
Moz Bar | | RucksackDigital0 -
Moz is only crawling 2 pages
Hi, I found a similar thread, but it did not provide a clear-cut answer. We have had this campaign running for over a year, and we are always adding content to the website, but Moz is only ever able to crawl 2 pages, Screaming Frog only picks up 12, but I know there is a lot more than that. None of our pages are set to no-index, so I do not know what is causing this. Welcoming any ideas/solutions. Thanks
Moz Bar | | GavinAdv0 -
Moz Crawl - 804 : HTTPS (SSL) error encountered when requesting page.
Got an issue sending a Crawl Request to https://www.usernamebuddy.com/ " "804 : HTTPS (SSL) error encountered when requesting page." I have tried to recrawl several times now same issue keeps occurring. I cannot see an error when I access the site am I missing something, if so how can I diagnose the issue and sort the problem? I have reviewed the source and cannot use any http: resources.
Moz Bar | | GrouchyKids0 -
Site Crawl report show strange duplicate pages
Beginning in early in Feb, we got a big bump in duplicate pages. The URLs of the pages are very odd: Example URL:
Moz Bar | | Neo4j
http://firstname.lastname@website.com/dir/page.php
is duplicate with http://website.com/dir/page.php I checked though the site, nginx conf files, and referral pages, and could not find what is prefixing the pages with 'http://firstname.lastname@'. Any ideas? The person whose name is 'Firstname Lastname' is stumped as well. Thanks.0 -
Getting 'Sorry, but that URL is inaccessible' error msg when trying to run On-Page Grader
I just signed up for MOZ Pro for the first time today. Tried to run the 'on-page grader' tool on some of my pages but I'm getting a 'Sorry, but that URL is inaccessible' error msg. I have verified against the robot.txt file that the pages are NOT blocking any crawlers. Can anybody help?
Moz Bar | | spinoki0 -
Mozbar showing 0 links for pages in the main nav.
I'm working on a site where the mozbar is showing 0 links for every page in the main nav menu but home. A crawl of the site isn't showing any issues with blocked or nofollowed meta robots. Is this simply a bug in mozbar? What else could be causing this? If this is a problem with on page seo what is the solution?
Moz Bar | | Kairos_Internet_Marketing0 -
Duplicate Page Content Report on MOZ
Hi, I am just wondering as to the accuracy of this report - does it pick up all the duplicate on page content? Or is there a limit? We have an ecommerce store with a lot of copied and pasted descriptions - just wondering if there is a limit on how much the moz crawler picks up? In other words, once we fix what MOZ has detected, will there be more detected because it is limited to display say up to 200?? Hope you understand what I mean. Thanks
Moz Bar | | bjs20100