Duplicate page found with MOZ crawl test?
-
When I crawl my website www.radiantguard.com, the crawl test comes back with what appears to be a duplicate of my home page:
http://www.radiantguard.com and http://www.radiantguard.com/
Does the crawler indeed see two different pages and therefore, are my search engine rankings potentially affected, AND
is this because of how my rel canonical is set up?
-
Thanks Ryan and Chiaryn! All looks good then! So happy
-
Hey Rhonda,
I took a look at your crawl test and I don't see that we are reporting any duplicate pages for http://www.radiantguard.com or http://www.radiantguard.com/. We are actually reporting that http://www.radiantguard.com/ is the canonical tag of http://www.radiantguard.com and we would never report a page as a duplicate of the canonical tag. We do consider these two pages as separate pages, as many sites do also treat them differently, so we try to encompass the most sites with the way we report on pages with trailing slashes.
You may still want to consider Ryan's advice regarding how to deal with these two pages, however, I just wanted to clarify that we are not reporting any duplicates on either pages. Here is a screenshot of the CSV that shows that these pages have no reported duplicates: http://www.screencast.com/t/5FHTfyQe
I hope that helps to clear things up a bit, but please do let me know if you have more questions about the crawl report.
-
Hi Rhonda. Google has a nice article on this very subject here: https://webmasters.googleblog.com/2010/04/to-slash-or-not-to-slash.html The main point is that it's a best practice to choose one or the other format for your locations. From the article:
You can do a quick check on your site to see if the URLs:
http://<your-domain-here>/<some-directory-here>/
(with trailing slash)
http://<your-domain-here>/ <some-directory-here>(no trailing slash)
don’t both return a 200 response code, but that one version redirects to the other.</some-directory-here></your-domain-here></some-directory-here></your-domain-here>If only one version can be returned (i.e., the other redirects to it), that’s great! This behavior is beneficial because it reduces duplicate content. In the particular case of redirects to trailing slash URLs, our search results will likely show the version of the URL with the 200 response code (most often the trailing slash URL) -- regardless of whether the redirect was a 301 or 302.
A 301 redirect is best as it should be the permanent structure of your site moving forward. Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz DA is not increasing
Hey my website best offset smokers under $1000 is not increasing DA. is there anyway to increase the DA currently its DA is 8
Moz Bar | | 0hjgh60 -
Duplicate content found in scan
On June 8th we ran a Moz Crawl on our site. We found 144 pages that were flagged with duplicate content.
Moz Bar | | StickyLife
Again on June 13th we ran another moz crawl on our site and found 137 pages that were flagged with duplicate content. Then one final scan on June 22nd with 161 pages of duplicate content. After comparing the 3 different scans I see that, without making any changes, pages that were not flagged as duplicate content are now being flagged as duplicate content. While at the same time, pages that were originally flagged as duplicate content are now no longer showing up with duplicate content. I could understand if we made some changes to these pages but no changes were made. For example: On the 8th this page was flagged as duplicate content - https://www.stickylife.com/star-magnet
On the 13th and 22nd it was not flagged as duplicate content but no changes were made to that page. For reference it was flagged as duplicate content with the following page: https://www.stickylife.com/baseball-glove-magnet This page was also Not changed or altered between between these dates. In addition, when Moz scans our site through our campaign every Friday the results do not match what we see when we do a manual scan. Moz's weekly scan only reveals 14 pages with duplicate content as opposed to the numbers you see above. Why such inconsistencies in the Moz Scans?0 -
Has anyone had to deal with Moz crawl issues on their Zendesk support site?
If so - how did you end up resolving them? For instance we have 85 "temporary redirect" errors from our Zendesk support site in our crawl error report and we don't have access to the robots.txt file through Zendesk.
Moz Bar | | zspace0 -
Time out writing responses to Moz Q&A
This is driving me crazy and making me wish to destroy everything I can reach with my hands. I like to write long curated answers to people questions on here. And evidently there's some sort of timeouts in Moz Q&A software. Because every time I answer to someone I get this fu#@!ng error message... http://imgur.com/ypVQ2hD So I go back, I lost everything and either give up or write one sentence. ypVQ2hD
Moz Bar | | max.favilli0 -
Site crawl errors - download list of all urls
Hi Ive provided my clients developers with the pdf reports of crawl errors but these seem to miss some urls I see there are lots of csv file download/email options Will the email csv button send a report of everything listing all urls that are missing from the pdfs ? if not will the more specific csv reports Would be good if i can press 1 button and get all issues listed with all urls It does look like this happens but i just want confirmed best way asap since need to provide reports urgently, any guidance much appreciated ? All Best Dan
Moz Bar | | Dan-Lawrence0 -
Crawl Test
Hello, Does the Crawl Test having some issues at the moment. It seems so slow. I submitted a website to crawl test 3-4 days ago and still its in progress. This usually only takes 24hrs max. THanks.
Moz Bar | | lueka0 -
On-page Grader and Cyrillic keywords
Hi all, I'm trying out the On-page grader and i see "funny" output when it comes to cyrillic keywords. I can see 73 occurrences in the title, 108 in the meta description tag, 34 in the H1 tag, etc. etc... Of course, these are not correct and i've manually checked. I've tested a few other pages in Bulgarian, using Cyrillic kewords... same story 😞 Please, let me know if there's something i'm missing, as this is crucial for my work. Thanks in advance.
Moz Bar | | jose_ugs0 -
Pro.moz.com referrals and transactions
Our Google Analytics account reports a significant number of visits and transactions as referrals from pro.moz.com. That is nice and we appreciate this but where is the traffic generated from ? (my first MOZ question)
Moz Bar | | silverpewter0