Crawl Diagnostics - nofollow - reducing duplicate pages
-
Hi
I'm looking at a crawl diagnostic report, I can see I have many duplicate pages, the reason for this is that when a brand filter is applied to a page. IE
www.mysite.com/mycategory - lets say this is the product listing page
www.mysite.com/category/mybrand - and this is the same page but with a brand filter applied
www.mysite.com/category/myotherbrand - and this is the same page but with a different brand filter appliedI had intially appendeded the meta title, description and keywords with some extra content if a brand filter was applied, because the page on the whole does have different content. IE I would have a custom meta information, H1 tag and products on that page just for that specific brand.
However I am wondering if these two pages are really just competing with each other as lots of the content will be the same.Should I scrap that approach and use either nofollow on the brand filter link, or simply use a canonical.
Thanks, James
-
I guess the issue here is really to what extent my pages are considered a subset of another. The way my page is coded, controlled via the cms, the subset page could have a lot more content specific to the brand for that page. IE: Different meta, banners, brand information
So, yes, the actual products themselves are a simple subset, but the surrounding content may be quite unique to that brand. Therefore should I still use canonical, not sure.... thoughts???
-
That is yet another reason Rel=canonical was created... for when one page is a subset of another page. E.g. Your Nike page is a subset of the Trainers page.
-
Hi, thanks for the reply, however the two pages with the brand filter do have different content, for example
Page 1a, trainers page with no filter applied, unique meta info
Page 1b, trainers page with Nike filter applied, unique meta info and has 20 products, all just Nike products
Page 1c, trainers page with Adidas filter applied, unique meta info and has 20 products, all just Adidas products
So all three pages have different content, its just that the 'combination page' 1a has products for both Nike and Adidas.
Hope that explains it better, I'm fully aware of the user for canonical but this is a bit of a grey area.
J
-
The whole point of canonical is to do what your describing.
Why specify a canonical page?
It's common for a site to have several pages listing the same set of products. For example, one page might display products sorted in alphabetical order, while other pages display the same products listed by price or by rating.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is the update site crawl feature following robot.txt rules?
I noticed that most of the errors would not be occurring if Moz's tool followed the rules implemented in sites robots.txt. Has anyone else seen this problem and do you know if Moz will fix this?
Moz Bar | | jamestown0 -
605 : Page banned by robots.txt
Hello everyone, I need experts help here, Please suggest, I am receiving crawl errors for my site that is , X-Robots-Tag: header, or tag. my robots.txt file is: User-agent: * Disallow:
Moz Bar | | bhomes0 -
Duplicating a Report to monthly from weekly
Is there a way to duplicate a weekly report and also run it monthly without redesigning it from scratch? I have a great report a client loves but they also want to see it monthly. Thanks! Melinda
Moz Bar | | timesharecmo0 -
The Moz Spam Score tells me my site has too few backlinks for such a large site. How many links per page would I need to not trigger this filter and stop appearing spammy?
Hello! One of my sites is triggering the 'too few backlinks for large site' filter. I am wondering how many backlinks I need so as not to trigger this. Many thanks for your help. Toby
Moz Bar | | T0BY0 -
URL inaccessible for On Page Grader
I am trying to use the on page grader however it is not working with my website. The URL is as follows: https://capbeast.com. I have been trying to read in older posts to see if https is now supported or not but have not found anything. I know there is no robots.txt issue as I am able to run the crawl test on our website fine. Is the issue on my end in regards to configuration or is due to DDos attacks? Any help would be appreciated. Thanks
Moz Bar | | MisterStitches0 -
Error for a page that doesn't exist.
Hi, I'm just trailing this service, and I have a couple of questions that I hope someone can help with. 1. I am getting a high priority error regarding a page not being able to be crawled - a 4XX error. Problem is, there is no such page in existence. The URL is my site/comments/feed It's driving me crazy. 2. I'm also getting errors based on missing meta tags in blog posts. I am adding tags at the time of posting, so I am unsure why these errors are showing up. Actually, I didn't add tags to all posts - but there are errors on ALL posts, even those I added tags to. Any help would be wonderful. Thanks!!! Hugh
Moz Bar | | hughanderson0 -
Duplicate content errors
Hi I am getting some errors for duplicate content errors in my crawl report for some of our products www.....com/brand/productname1.html www.....com/section/productname1.html www.....com/productname1.html we have canonical in the header for all three pages rel="canonical" href="www....com/productname1.html" />
Moz Bar | | phes0