Duplicate page found with MOZ crawl test?
-
When I crawl my website www.radiantguard.com, the crawl test comes back with what appears to be a duplicate of my home page:
http://www.radiantguard.com and http://www.radiantguard.com/
Does the crawler indeed see two different pages and therefore, are my search engine rankings potentially affected, AND
is this because of how my rel canonical is set up?
-
Thanks Ryan and Chiaryn! All looks good then! So happy
-
Hey Rhonda,
I took a look at your crawl test and I don't see that we are reporting any duplicate pages for http://www.radiantguard.com or http://www.radiantguard.com/. We are actually reporting that http://www.radiantguard.com/ is the canonical tag of http://www.radiantguard.com and we would never report a page as a duplicate of the canonical tag. We do consider these two pages as separate pages, as many sites do also treat them differently, so we try to encompass the most sites with the way we report on pages with trailing slashes.
You may still want to consider Ryan's advice regarding how to deal with these two pages, however, I just wanted to clarify that we are not reporting any duplicates on either pages. Here is a screenshot of the CSV that shows that these pages have no reported duplicates: http://www.screencast.com/t/5FHTfyQe
I hope that helps to clear things up a bit, but please do let me know if you have more questions about the crawl report.
-
Hi Rhonda. Google has a nice article on this very subject here: https://webmasters.googleblog.com/2010/04/to-slash-or-not-to-slash.html The main point is that it's a best practice to choose one or the other format for your locations. From the article:
You can do a quick check on your site to see if the URLs:
http://<your-domain-here>/<some-directory-here>/
(with trailing slash)
http://<your-domain-here>/ <some-directory-here>(no trailing slash)
don’t both return a 200 response code, but that one version redirects to the other.</some-directory-here></your-domain-here></some-directory-here></your-domain-here>If only one version can be returned (i.e., the other redirects to it), that’s great! This behavior is beneficial because it reduces duplicate content. In the particular case of redirects to trailing slash URLs, our search results will likely show the version of the URL with the 200 response code (most often the trailing slash URL) -- regardless of whether the redirect was a 301 or 302.
A 301 redirect is best as it should be the permanent structure of your site moving forward. Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz on-page grader can't see keyword in H1
Hi, Trying to do grade for whatiswhere.com, keyword 'poi search'. The tool can't see keyword in h1, but It is there. Could you please check what is the problem? Thank you, Andrei.
Moz Bar | | Anazar_20010 -
Is the update site crawl feature following robot.txt rules?
I noticed that most of the errors would not be occurring if Moz's tool followed the rules implemented in sites robots.txt. Has anyone else seen this problem and do you know if Moz will fix this?
Moz Bar | | jamestown0 -
What does it mean when Moz KW explorer returns a negative keyword difficulty score (eg -2)?
I recently did a keyowrd difficulty lookup in Moz keyword explorer as usual and for the first time a saw several (out of 100s) of negative keyowrd scores (generally -2). Is this a bug, what does it mean?
Moz Bar | | FlagshipCons1 -
External Links not showing in MOZ?
Hello:) I have a ton of external links on my site, but there not showing on MOZ? The reason i'm slightly concerned is because my top competitor has 80 and I show as only having 3? Does any one know why this would be? Also, my traffic on MOZ is a lot lower then my traffic report on Google Analytics? Is that normal, & which should I trust more? Here's my Site: Www.ThumannAgency.com Thank you in advance:)
Moz Bar | | MissThumann0 -
How does a non-traditional TLD impact Moz's crawl test?
I have a client who moved from a .com to .academy domain 6 months ago, and their current crawl tests are coming back with a universal page authority of 1, along with 0 indexed backlinks. The previous version of the site had an average page authority of 35-40, the site architecture and content are nearly identical, and there are no other errors or red flags in the crawl report that would hold back their organic rankings. In fact, looking at the site's analytics account, I can see dozens of sites that provide current and properly functioning backlinks, non of which are listed on the crawl test. So the question is - is Moz currently unable to properly crawl a .academy (or any other non-traditional TLD) site, or is there some deeper issue with the site's SEO that I'm not seeing? Thanks!
Moz Bar | | ThinkAOR1 -
Suggestion: Moz Domain Authority should take disavow into account
Since Moz is trying to predict how Google ranks your site, and Google claims to take the disavow file into account, I'd like to suggest that Moz allow webmasters to upload their disavow file. I imagine this data would be useful to Moz in determining Domain Authority (they may even think of other ways to use it and might even help come to a conclusion on the great debate) and it gives a chance for sites to improve their Moz DA when they are bombarded by spammy links. I'd love to hear the community's thoughts on this idea, as well as the what Wizards of Moz have to say.
Moz Bar | | YairSpolter1 -
I have been unable to use the export button on any of the Moz pages.
Every time I click the export button on the upper right portion of the page, it says "preparing to export", but either nothing is exported or a blank document is downloaded. I was specifically working with the Fresh Web Explorer but have noticed this on all pages. Is anyone getting this export function to work?
Moz Bar | | Manseo0 -
Error for a page that doesn't exist.
Hi, I'm just trailing this service, and I have a couple of questions that I hope someone can help with. 1. I am getting a high priority error regarding a page not being able to be crawled - a 4XX error. Problem is, there is no such page in existence. The URL is my site/comments/feed It's driving me crazy. 2. I'm also getting errors based on missing meta tags in blog posts. I am adding tags at the time of posting, so I am unsure why these errors are showing up. Actually, I didn't add tags to all posts - but there are errors on ALL posts, even those I added tags to. Any help would be wonderful. Thanks!!! Hugh
Moz Bar | | hughanderson0