Duplicate page error from SEOmoz
-
SEOmoz's Crawl Diagnostics is complaining about a duplicate page error. I'm trying to use a rel=canonical but maybe I'm not doing it right.
This page is the original, definitive version of the content:
https://www.borntosell.com/covered-call-newsletter/sent-2011-10-01
This page is an alias that points to it (each month the alias is changed to point to the then current issue):
https://www.borntosell.com/covered-call-newsletter/latest-issue
The alias page above contains this tag (which is also updated each month when a new issue comes out) in the section:
Is that not correct? Is the https (vs http) messing something up?
Thanks!
-
Thanks, Ryan.
My entire site is https. I 301 any http request to the https version. That works fine.
I also 301 any non-www to the www version. That works.
I'm not currently doing anything special with the trailing slash (or lack of). I guess I should 301 anything with a trailing slash to the non-slash version, rather than serve up slash and non-slash each as status 200.
Appreciate the guidance...
-
What would you expect to happen?
Well, when look at the current Q&A URL:
http://www.seomoz.org/q/duplicate-page-error-from-seomoz
now try adding a trailing slash to it
http://www.seomoz.org/q/duplicate-page-error-from-seomoz/
in this case the URL with the trailing slash is rejected, which is expected. What I don't expect is for the page to be redirected to the root Q&A page. Not sure why that was implemented here and it seems unusual to me.
An example of a site with the (close to) expected behavior is the Distilled site:
http://www.distilled.net/blog/seo/7-technical-seo-wins-for-web-developers/
If you try to remove the trailing slash, you will notice the URL is changed back to a URL with the trailing slash.
What I am a bit surprised about in the Distilled example is the redirected page shows a 200 header code. I believe it should display a 301 redirect from the page without the trailing slash to the page with it.
Overall I would say this is very nit-picky SEO but since the topic came up, it is relevant. Actually I am curious enough about this I will use my staff question this month on this topic
Should I 301 redirect the url with the slash to the url without the slash, or something else?
Yes. This issue is very similar to www vs non-www. Each page should have one version of a URL available and not more. It is not so important which you choose in as much as you make a decision and remain consistent.
The Distilled site chooses to end all URLs with a slash. That is a fine choice. SEOmoz chooses (as do I) to end category pages with a slash and actual web pages without a slash. Using this system if you look at a URL and it ends with a slash, you know you can go deeper. If the URL does not have a slash, you have reached the bottom.
Wow. This is the most time I have spent thinking about this little detail of SEO
-
Thanks for the response. A followup question.... when you say:
"when I enter the same URL with a trailing slash, the same page appears"
What would you expect to happen?
Should I 301 redirect the url with the slash to the url without the slash, or something else?
Thanks.
-
Your example of how the canonical tag is presented is perfect. You can verify your canonical tag is recognized using the MozBar Analyze Page > Page Attributes.
The https should not cause any issue.
Is it possible something else is causing the duplicate content warning? For example, I noticed when I enter the same URL with a trailing slash, the same page appears:
https://www.borntosell.com/covered-call-newsletter/latest-issue
https://www.borntosell.com/covered-call-newsletter/latest-issue/
Of course, both pages are canonicalized properly but it does show there is an issue on your site which should be addressed. Technically adding a slash to the end of a URL is a different page in much the same way that adding or removing the "www" subdomain offers a different page.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can I remove on-page reports from the Summary page?
Hi, I'd like to remove some on-page reports from the Summary page. I've already stopped them from running weekly. Is there a way to remove them completely?
Moz Pro | | csmm0 -
Seomoz duplicate rel="next" pages
Hello my page has this Although with seomoz crawl it says that this pages has duplicate titles. If my blog has 25 pages, i have according seomoz 25 duplicate titles. Can someone tell me if this is correct or if the seomoz crawl cannot recognize rel="next" or if there is another better way to tell google when there a pages generated from the blog that as the same title Should i ignore these seomoz errors thank you,
Moz Pro | | maestrosonrisas0 -
Open Site Explorer is showing "No Data" for my page titles under the "Top Pages" Tab
This is for my site: www.kibin.com/ Does this mean there is something wrong with how we're titling our pages? We're working on our on-page SEO, titles, meta descriptions this week and getting them up to snuff. I don't understand what is going on here or if it's something to be worried about. Thanks!
Moz Pro | | Kibin0 -
SEOmoz showing crawl errors but webmastertools says no errors, need help!
Hi this is my first question and i couldnt find a similar question on here. basically i have a clients website that is showing 150 duplicate page titles and content errors plus others. SEOmoz analysis is showing me for example is 3 duplicate hompage URLS: 1.www.domain.com 2.domain.com 3.www.domain.com/index.html all 3 are the same page. after explaining to the guy (who built the website) the errors, he ensured me that the main URL is URl 1. and the other 2 are 301 redirects. however SEOmoz analysis doesnt seem to change the results and webmastertools doesnt seem to show any errors at all. also if i try all 3 URL's there are no redirects to URL 1. any help or clarity would be awesome! Thanks e-bob
Moz Pro | | bobsnowzell0 -
Roger keeps telling me my canonical pages are duplicates
I've got a site that's brand spanking new that I'm trying to get the error count down to zero on, and I'm basically there except for this odd problem. Roger got into the site like a naughty puppy a bit too early, before I'd put the canonical tags in, so there were a couple thousand 'duplicate content' errors. I put canonicals in (programmatically, so they appear on every page) and waited a week and sure enough 99% of them went away. However, there's about 50 that are still lingering, and I'm not sure why they're being detected as such. It's an ecommerce site, and the duplicates are being detected on the product page, but why these 50? (there's hundreds of other products that aren't being detected). The URLs that are 'duplicates' look like this according to the crawl report: http://www.site.com/Product-1.aspx http://www.site.com/product-1.aspx And so on. Canonicals are in place, and have been for weeks, and as I said there's hundreds of other pages just like this not having this problem, so I'm finding it odd that these ones won't go away. All I can think of is that Roger is somehow caching stuff from previous crawls? According to the crawl report these duplicates were discovered '1 day ago' but that simply doesn't make sense. It's not a matter of messing up one or two pages on my part either; we made this site to be dynamically generated, and all of the SEO stuff (canonical, etc.) is applied to every single page regardless of what's on it. If anyone can give some insight I'd appreciate it!
Moz Pro | | icecarats0 -
Truncate page URLs
We have some pages (for example a contact us form) for which the URL is modified by the CMS depending on the referring page (this helps to put the form submission in context for the sales reps who get the contact submission). The SEOmoz crawler considers each URL a new page -- and so numbers like in diagnostics are all inflated as the same page is listed multiple times (e.g. for too many links) Is there a setting to change what the crawler considers to be the same page? Here are two URLs for the same page that the reports treat as separate pages: http://www.spirent.com/About-Us/Contact_us.aspx?referurl=0F528F4D703D8BB3523738D6373AA8AD http://www.spirent.com/About-Us/Contact_us.aspx?referurl=10ACDA6055244E369395223437FDCF30 The page is actually: http://www.spirent.com/About-Us/Contact_us.aspx Thanks Ken
Moz Pro | | spirent.marcom0 -
Seomoz crawling filtered pages
Hi, I just checked an seo campaign we started last week, so I opened seomoz to see the crawl diagnostics. Lot's of duplicate content & duplicate titles showing up, but that's because Rogerbot is crawling all of the filtered pages as well. How do I exclude these pages from being crawled? /product/brand-x/3969?order=brand&sortorder=ASC
Moz Pro | | nvs.nim
/product/brand-x/3969?order=popular&sortorder=ASC
/product/brand-x/3969?order=popular&sortorder=DESC&page=10
/product/brand-x/3969?order=popular&sortorder=DESC&page=110 -
SEOMoz Keyword Limit
I am trying to add keywords to my SEOMoz campaign and it says I have reached my 300 KW limit eventhough I have only added 1 word! Any suggestions? uwt2V
Moz Pro | | theLotter0