No-index all the posts of a category
-
Hi everyone!
I would like no-indexing all the posts of a specific category of my wordpress site.
The problem is that the structure of my URL is composed without /category/: www.site-name.ext/date/post-name/
so without /category-name/Is possibile to disallow the indexing of all the posts of the category via robots.txt?
Using Yoast Plugin I can put the no-index for each post, but I would like to put the no-index (or disallow/) a time for all the post of the category.
Thanks in advance for your help and sorry for my english.
- Mike
-
Sure, without /category/ in the URL structure I can't block Googlebot using the robots.txt
No problem, now I can use the noindex for all the posts.
Thank you so much Oleg.
Regards,
- MIke
-
With that code, Google won't index any pages within that particular category.
Unfortunately, without a specific folder pattern, you cannot block via robots.txt
-
Hi Oleg, thanks for your help.
I did just some tests and does it seems to work fine.
Do you think is possible to block Google bot to indexing all the post of a category?in this way (disallow/ in the robots.txt) I could save the Google crawle budget for the pages of my site that I want to index.
Thanks a lot for your help Oleg.
Have a nice weekend,- Mike
-
Wordpress Admin > Posts > Categories > Edit the category you want to noindex > Set "always noindex" for "Noindex this category" box
EDIT: looks like that just noindexes the actual category page.
Here is a workaround I found...
-
Find the category ID (WP Admin > Posts > Categories > Edit the category you want to noindex > look at URL for the tag_ID # (this is the category ID))
-
Edit your theme header and include:
<?php if (is_single() && in_category(array(###))) { echo ''; } ?>
where ### is the category ID
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How do I keep content-refreshment manageble for large site with facetted product categories?
Dear MOZ'ers,
On-Page Optimization | | Marketing-Omoda
i hope you can help me with the following issue: As a fashion e-commerce site we have a category structure by gender: , brand, product-category and colour. We sell over 250 brands in 50 categories. Off course, we don't sell products in every category for all brands but, in general, we sell 3 or 4 product categories for a brand. Next to this, we also have unique content for brand-product-gender (in fact this is the most common in our site-structure, since fashion is really a gender-based product.) We are planning to leave the site category as it is. we rank well for specific products like 'blue mens sneakers' My question is about copy, or more specific: to keep content-refreshment manageble. At the moment we have a small text at the top of the page and long form content on the bottom (very low below the fold, near the footer, only shown when the product-lister is) Because of seasonality in fashion, category text are regularly updated. As you can imagine, this is quit some work and pretty expensive. So now my question is: on which page level should you advice to have long form content, or distinctive content at all?
On the one hand I'm really sceptical about the value of the text at the bottom, on the other hand I am afraid that, should I decide to remove content from lower hierarchy pages, I might give the wrong signal to search engines: making my site from content rich content modest.0 -
Best category page structure on MY ecommerce site? Advice please
Hi all, I run the site: http://goo.gl/YATL2i I have had this category set up like this for a while now - but wonder if its confusing to google, and potentially my users... let me start by saying my products are available in 3 formats (soon to be 4), so for example i have 3 pages for cctv systems: Analogue / SD cctv systems: http://goo.gl/SPkdYW hd sdi systems: http://goo.gl/uksRAD ip systems: http://goo.gl/UMHBd0 each of the above sub categories then have a further sub category of 2, 4, 6, 8, 10 or 16 camera kit page... I am trying to figure out if it would be better to just have one "cctv systems" page, and use filters in the left menu so users can filter by format, number of cameras etc etc... but these filters would not navigate to other pages but simply limit the view on the one "cctv systems" page. If you think 1 page with filters is best - can you then advise what should i do with all the sub category pages i no longer need? 301 rediret to the main cctv systems page? Basically i currently have my site set up so cctv products are categorised by the format i,e SD, HD-SDI or IP... Which i thought was very important the user doesnt mix formats as it can not work - but am thinking maybe i should catorgorize by type i.e CCTV Camera, CCTV Recorders or CCTV Systems, and then use filters to drill further down in the categories. Any thoughts on this would be much appreciated. thanks
On-Page Optimization | | isntworkdull0 -
No index, or no index no follow?
Wondering if I could garner some views on this issue please. I'm about to add an affiliate store to a website I own, the site has a couple of pages of unique content (blogs, articles, advice etc on home improvement - all written by my team). Obviously, the affiliate store will not be unique content, it will be made using the datafeeds from cj.com et al, and so I don't want to get any duplicate content type penalties from Google for this store. Should I add a no index to the pages and allow the bots to still crawl them, or should I add no index and no follow? Ideally I would like to get the affiliate store category pages indexed as they will be a mixture of lots of different merchants and be fairly unique. Can Google still mark the site down for duplicate content if it can crawl it, even if it is noindex? Thanks, Carl
On-Page Optimization | | Grumpy_Carl0 -
How do i block an entire category/directory with robots.txt?
Anyone has any idea how to block an entire product category, including all the products in that category using the robots.txt file? I'm using woocommerce in wordpress and i'd like to prevent bots from crawling every single one of products urls for now. The confusing part right now is that i have several different url structures linking to every single one of my products for example www.mystore.com/all-products, www.mystore.com/product-category, etc etc. I'm not really sure how i'd type it into the robots.txt file, or where to place the file. any help would be appreciated thanks
On-Page Optimization | | bricerhodes0 -
Changing Title Tags once Indexed and positioned?
Hello, Would it be wise to change title tags on a page that is optimized and ranked already in google? These are sports pages, and the teams we are targeting are now in the playoffs so we wanted to insert that into our Title? Thanks!!
On-Page Optimization | | TP_Marketing0 -
Is It better to have a blogroll style Homepage to your website? or one main post?
Does a site rank better or is it better to have a blogroll style homepage linking to all of your other post in your website. Or is it better to have one homepage post for the main keyword theme of the website, with the other post titles in a side column?
On-Page Optimization | | nyphenom0 -
Re SEO, Is it better to have a mega menu or one split into categories?
Hi From an SEO perspective is it better to have 1 large listed menu - over 100 internal links - or say a much smaller menu split into say 10 categories - so 10 links.
On-Page Optimization | | joeprice
This menu would be appearing on nearly all pages but not the home page In terms of the user experience, in my case, I have a feeling having 1 large menu is possibly preferable as it reduces the number of clicks the user makes to get to the desired information and categorisation can be a bit subjective, but i'd like some advice from an SEO perspective. Thanks0 -
On my site, www.myagingfolks.com, only a small number of my pages appear to be indexed by google or yahoo. Is that due to not having an XML sitemap, keywords, or some other problem?
On my site, www.myagingfolks.com, only a small number of my pages appear to be indexed by google or yahoo. I have thousands of pages! Is that due to not having an XML sitemap, keywords, or some other problem?
On-Page Optimization | | Jordanrg0