Duplicate content - Which is the other duplicate page?
-
Hi
I just ran a campaign, and I got a duplicate content warning for some of my pages. When I go into the diagnostic report, I am unable to find the page detected by google as 'duplicate' to the main page. Unless I know which 2 pages are being detected as duplicate, it'll be really difficult to actually solve the problem.
Would be great to have any kind of help here.
Thanks in advance!
-
I'm not aware of an outstanding issue with downloading CSVs. Could you go to http://moz.com/help/contact and open a ticket so we can investigate? Thanks, and so sorry for the troubles!
-
Trying to download the CSV for my campaign but it returns an empty page.
Kind of annoyed because Moz is not helping me identify the URLs with duplicate content. There's no column that Peter is referencing above and I can't download the CSV.
-
Hi Mark
Yes, login to your account. By default the system currently logs you into Moz Pro.
At the top right there should be a light green button that says "Start using Moz Analytics". Click that and if you will be logged into it.
Yesterday, there was a link which made it possible to switch back to Moz Pro, but I cannot find it now, so it may be that the only way to get back to Moz Pro is logging out and in again.
I hope that helps,
Peter
-
Hi Peter,
Could you detail exactly how to "switch to the Moz Pro interface?" Sure I'm missing something obvious but can't find a thing!
Thanks.
-
Thanks Peter! That makes sense.
-
Thanks a lot for the prompt response Jackie!
-
You are correct. For Duplicate Page Content, we are looking for pages that have 95% or greater overlap, or similarity in the content and code. If you're looking for more info, our Help Team wrote a great article about how our crawler defines each crawl diagnostic. Feel free to check it out!
Jackie
-
Hi Ravijot,
The only examples I have seen are those where the whole page is a duplicate caused by two URLs pointing to the same page.
You could though have two separate duplicate pages. The Moz report says that Duplicate Page Content is "Code and content similar or identical to code and content on other pages on your site". In the the case that the code and content is 'similar' I don't think it will tell you what is similar only the fact that the Moz crawler has found a large portion of a page that is identical and some different, thereby making the page 'similar'.
Maybe though a Moz support member could clarify my assumption on that.
Peter
-
Hi Ben
I have just been looking at this again and cab see that the report you were looking at was the duplicate page report from Moz Analytics rather than from Moz Pro.
The report in Moz Analytics is different and does not provide a link to view the duplicate pages on screen. However, having just downloaded the Crawl diagnostics export file in Moz Analytics it does now show the URL that was checked in column U of the spreadsheet and in column AF the duplicate page URL if one was found for the URL being checked. When there is more than one duplicate page found, the downloaded report has extra lines for each duplicate found for the checked URL.
Alternatively, you could switch to the Moz Pro interface and view the Duplicate Page Content report in that, which does give you a hyperlinked number (showing how many duplicate pages have been found for a URL) which if you click it you are shown the list of URLS of duplicated pages for that URL.
A screenshot of that is attached.
I hope that helps,
Peter
-
On a related note, is it possible to figure out 'what' exactly is duplicate between any 2 pages. Moz shows a lot of pages on my website that have different content, as 'duplicate pages'. Is there any way to figure out what this duplicate content is?
Thanks in advance!
-
Thanks Jackelyn. Look forward to this getting fixed.
-
Thanks for your response Peter. As mentioned by Jackelyn below, the column shows up as blank for me. Looking forward to the bug getting fixed.
Thanks again!
-
Hello!
In Moz Analytics, users should be able to download the csv to see the urls that have duplicate content. However, there is a bug that makes that column blank. Sorry about this! We realized that it somehow disappeared in those csv reports, and our Engineers are working to fix it. It should be fixed this week, and I'll update this forum when it's out!
Best,
Jackie | Product Planner
-
Same issue for me. I have the pages ID'd that have duplicated content but can't find the URL's those pages share the same content with.
In my report I DO NOT have the column of pages it reports as duplicated or a column entitled "Other URLs".
The columns in my report for "Pages with Duplicate Page Content" is as follows:
URL / Page Authority / Linking Root Domains / External Link Count / Internal Link Count / Status CodeIs there another view of the data I'm missing? BTW I'm under Search > Crawl Diagnostics > and Analyze Pages with Duplicate Page Content
-
Hi Ravijot
I assume you mean the diagnostic report in Moz and not anything you have seen in Google webmaster tools?
If the Moz report, you will see the column of pages it reports as duplicated. Alongside, you will see a number in the column which is titled "Other URLs". If you click the number, it will then show you the other URLs which are returning the duplicate page.
It's likely that these URLs are all pointing to the same page rather than you actually having duplicate pages.
Hopefully that will help you to find out what is wrong and fix it, but post back if you are still stuck.
Peter
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz bot has trouble crawling Angular JS - I believe it's seeing the SPA (Single Page Application) before Universal. Anyone else have this issue? What is the fix?
The Moz bot user agent detection settings are able to read Universal, but the Single Page Application (SPA) version partially loads on the website before Universal. Because of this, Moz (and possibly search engines) think we have massive duplicate content issues. For example, the crawl report said a particular product page (which has about 1,000 words) has 33,000 words and has duplicate content with over 300 other pages. This makes me believe it's only picking up the SPA version. Has anyone come across this, and what would be the fix?
Moz Bar | | laurengdicenso1 -
Calling all 301 htaccess Guru's - www to non www - then to https + Redirect homepage to inner page
I have tried searching, multiple opinions and multiple things that supposedly work. What I have now, seems to work from an end user perspective, but Roger tells me otherwise: Redirect Chain issue....redirect, which redirects which redirects etc..... FIRST, we need to redirect all www to non www. SECOND, we need to redirect all to https. THIRD, we need to redirect the homepage to an inner page. (Got to love BOGUS DMCA complaints! :)?) So far we have: RewriteEngine on
Moz Bar | | Jes-Extender-Australia
RewriteCond %{HTTPS} off
RewriteRule ^(.*)$ https://%{HTTP_HOST}%{REQUEST_URI} [L,R=301]
RewriteCond %{HTTP_HOST} ^mydomain.com.au$ [OR]
RewriteCond %{HTTP_HOST} ^www.mydomain.com.au$
RewriteRule ^/?$ "https://mydomain.com.au/inner-page-here" [R=301,L] Plus down the page there is the usual wordpress settings: <ifmodule mod_rewrite.c="">RewriteEngine On
RewriteBase /
RewriteRule ^index.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]</ifmodule> So, why does it seem to work for the end user, but Roger has his knickers in a knot saying, redirect, to redirect to redirect etc? Namaste and many thank you's in advance 🙂0 -
301 Redirects detected as duplicates
I have 19 pages that are all 301 redirected to the same page. Moz is detected these 19 pages a duplication's of each other. Does anyone know how to solve this issue?
Moz Bar | | Worship_Digital0 -
On-Page Grader supporting HTTPS?
Hi there, I am getting the error "Sorry, but this URL is inaccessible" on the Moz On-Page Grader. I have tested with multiple URL's but any that link to my site give the error. I have noticed my site's URL's redirect to https so my question is..is the on-page grader in-compatible with https? Cheers!
Moz Bar | | ToteIreland
Ross0 -
Moz crawler only crawls one page?!
Hello there, I'm using Moz for a while and I'm very pleased with the tool and community. But for the first time I encountered a problem. We are trying to run a crawler for a client's website but only one page (only the homepage) was crawled. We tried to do a test on a more detailed level (maybe there is something wrong with the homepage). My campaign test's crawl came back for the Producten folder (level deeper than homepage), and it was also only a 1 page crawl with a 200 status. I did look at the robots.txt file now, and it is very restrictive, but there is nothing that I can clearly see that would explain why the crawl isn't working. Hopefully someone can point us at the right direction. Thanks in advance, Jeremy
Moz Bar | | mediaxplain.nl0 -
I'm getting a Crawl error 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag
The website is www.bigbluem.com and is a wordpress site. I'm getting the following error: 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag But what is weird is the domain it lists below that is http://None/BigBlueM.com Any advice?
Moz Bar | | TumbleweedPDX1 -
On Page Grader - We have keyword in Meta Description But does not show up
The on-page grader is not counting/picking up the keyword in the meta description. We have double checked the meta description and re-uploaded the page, and checked the source code on-line. The keyword is there in meta description, but not showing up in on-page-grader. https://www.trustdeedrealestateinvesting.com/trimarkfunding/buy-first-trust-deeds.html keyword buy first trust deeds
Moz Bar | | Manifestation0 -
Moz On-page is not working
My on-page is not working....I do have 3 keywords in the 1º position of Google.pt and the Moz is not reporting nothing....bug?
Moz Bar | | Popbox0