Duplicate page error from SEOmoz
-
SEOmoz's Crawl Diagnostics is complaining about a duplicate page error. I'm trying to use a rel=canonical but maybe I'm not doing it right.
This page is the original, definitive version of the content:
https://www.borntosell.com/covered-call-newsletter/sent-2011-10-01
This page is an alias that points to it (each month the alias is changed to point to the then current issue):
https://www.borntosell.com/covered-call-newsletter/latest-issue
The alias page above contains this tag (which is also updated each month when a new issue comes out) in the section:
Is that not correct? Is the https (vs http) messing something up?
Thanks!
-
Thanks, Ryan.
My entire site is https. I 301 any http request to the https version. That works fine.
I also 301 any non-www to the www version. That works.
I'm not currently doing anything special with the trailing slash (or lack of). I guess I should 301 anything with a trailing slash to the non-slash version, rather than serve up slash and non-slash each as status 200.
Appreciate the guidance...
-
What would you expect to happen?
Well, when look at the current Q&A URL:
http://www.seomoz.org/q/duplicate-page-error-from-seomoz
now try adding a trailing slash to it
http://www.seomoz.org/q/duplicate-page-error-from-seomoz/
in this case the URL with the trailing slash is rejected, which is expected. What I don't expect is for the page to be redirected to the root Q&A page. Not sure why that was implemented here and it seems unusual to me.
An example of a site with the (close to) expected behavior is the Distilled site:
http://www.distilled.net/blog/seo/7-technical-seo-wins-for-web-developers/
If you try to remove the trailing slash, you will notice the URL is changed back to a URL with the trailing slash.
What I am a bit surprised about in the Distilled example is the redirected page shows a 200 header code. I believe it should display a 301 redirect from the page without the trailing slash to the page with it.
Overall I would say this is very nit-picky SEO but since the topic came up, it is relevant. Actually I am curious enough about this I will use my staff question this month on this topic
Should I 301 redirect the url with the slash to the url without the slash, or something else?
Yes. This issue is very similar to www vs non-www. Each page should have one version of a URL available and not more. It is not so important which you choose in as much as you make a decision and remain consistent.
The Distilled site chooses to end all URLs with a slash. That is a fine choice. SEOmoz chooses (as do I) to end category pages with a slash and actual web pages without a slash. Using this system if you look at a URL and it ends with a slash, you know you can go deeper. If the URL does not have a slash, you have reached the bottom.
Wow. This is the most time I have spent thinking about this little detail of SEO
-
Thanks for the response. A followup question.... when you say:
"when I enter the same URL with a trailing slash, the same page appears"
What would you expect to happen?
Should I 301 redirect the url with the slash to the url without the slash, or something else?
Thanks.
-
Your example of how the canonical tag is presented is perfect. You can verify your canonical tag is recognized using the MozBar Analyze Page > Page Attributes.
The https should not cause any issue.
Is it possible something else is causing the duplicate content warning? For example, I noticed when I enter the same URL with a trailing slash, the same page appears:
https://www.borntosell.com/covered-call-newsletter/latest-issue
https://www.borntosell.com/covered-call-newsletter/latest-issue/
Of course, both pages are canonicalized properly but it does show there is an issue on your site which should be addressed. Technically adding a slash to the end of a URL is a different page in much the same way that adding or removing the "www" subdomain offers a different page.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should I set blog category/tag pages as "noindex"? If so, how do I prevent "meta noindex" Moz crawl errors for those pages?
From what I can tell, SEO experts recommend setting blog category and tag pages (ie. "http://site.com/blog/tag/some-product") as "noindex, follow" in order to keep the page quality of indexable pages high. However, I just received a slew of critical crawl warnings from Moz for having these pages set to "noindex." Should the pages be indexed? If not, why am I receiving critical crawl warnings from Moz and how do I prevent this?
Moz Pro | | NichGunn0 -
Moz Crawl Test error
Moz crawl test show blank report for my website test - guitarcontrol.com. Why??? Please suggest.
Moz Pro | | zoe.wilson170 -
How can I deal with tag page duplicate issues
The Moz crawler reported some dupliated issues. Many of them have to do with tags.
Moz Pro | | IamKovacs
Each tag has a link, and as some articles are under several tags, these come up as duplicate content. I read Dr Peter's piece on Canonical stuff, but it's not clear to me if any of these are the solution. Perhaps the solution lies somewhere else? Maybe I need to block the robots from these urls (But that seems counter-SEO-productive) Thanks
Kovacs0 -
Duplicate page report
We ran a CSV spreadsheet of our crawl diagnostics related to duplicate URLS' after waiting 5 days with no response to how Rogerbot can be made to filter. My IT lead tells me he thinks the label on the spreadsheet is showing “duplicate URLs”, and that is – literally – what the spreadsheet is showing. It thinks that a database ID number is the only valid part of a URL. To replicate: Just filter the spreadsheet for any number that you see on the page. For example, filtering for 1793 gives us the following result: | URL http://truthbook.com/faq/dsp_viewFAQ.cfm?faqID=1793 http://truthbook.com/index.cfm?linkID=1793 http://truthbook.com/index.cfm?linkID=1793&pf=true http://www.truthbook.com/blogs/dsp_viewBlogEntry.cfm?blogentryID=1793 http://www.truthbook.com/index.cfm?linkID=1793 | There are a couple of problems with the above: 1. It gives the www result, as well as the non-www result. 2. It is seeing the print version as a duplicate (&pf=true) but these are blocked from Google via the noindex header tag. 3. It thinks that different sections of the website with the same ID number the same thing (faq / blogs / pages) In short: this particular report tell us nothing at all. I am trying to get a perspective from someone at SEOMoz to determine if he is reading the result correctly or there is something he is missing? Please help. Jim
Moz Pro | | jimmyzig0 -
The pages that add robots as noindex will Crawl and marked as duplicate page content on seo moz ?
When we marked a page as noindex with robots like {<meta name="<a class="attribute-value">robots</a>" content="<a class="attribute-value">noindex</a>" />} will crawl and marked as duplicate page content(Its already a duplicate page content within the site. ie, Two links pointing to the same page).So we are mentioning both the links no need to index on SE.But after we made this and crawl reports have no change like it tooks the duplicate with noindex marked pages too. Please help to solve this problem.
Moz Pro | | trixmediainc0 -
SEOmoz Campaign Setup: What would you do?
I've been using moz for nearly a year now. Initially when I set up our site (rac.com.au) it was as a single campaign for the rac.com.au domain. However, our business has a number of different product offerings and marketing teams (Insurance, finance, travel/tourism, automotive, security etc) - would I be better off setting each of these 'sub' brands as a campaign on their own using the 'folder' campaign setup? For example, have a campaign setup for the Insurance business (rac.com.au/insurance) folder, Finance business (rac.com.au/finance) and so forth? The advantage I see to the folder campaign setup is more specific reporting for each of the business units. Are there disadvantages to this? Any recommendations would be greatly appreciated. Cheers Ryan
Moz Pro | | Hutch_e0 -
I've got quite a few "Duplicate Page Title" Errors in my Crawl Diagnostics for my Wordpress Blog
Title says it all, is this an issue? The pages seem to be set up properly with Rel=Canonical so should i just ignore the duplicate page title erros in my Crawl Diagnostics dashboard? Thanks
Moz Pro | | SheffieldMarketing0 -
Where do these error 404 pages come from
Hi, I've got a list of about 12 url's in our 404 section on here which I'm confused about. The url's relate to Christmas so they have not been active for 9 months. Can anyone answer where the SeoMoz crawler found these url's as they are not linked to on the website. Thanks
Moz Pro | | SimmoSimmo0