Index or not index Categories
-
We are using Yoast Seo plugin. On the main menu we have only categories which has consist of posts and one page. We have category with villas, category with villa hotels etc.
Initially we set to index and include in the sitemap posts and excluded categories, but I guess it was not correct.
Would be a better way to index and include categories in the sitemap and exclude the posts in order to avoid the duplicate? It somehow does not make sense for me, If the posts are excluded and the categories included, will not then be the categories empty for google? I guess I will get crazy of this.
Somebody has perhaps more experiences with this?
-
No problem at all, glad I could help!
Good luck with the site!
-
You are really amazing Lewis! I understand what you mean with no indexing the pages 2, 3 etc..Yoast has there such option that I can mark it and it will not be indexing them.
Thank you so much for the tool you gave me to visit yoast site!!! It worked! Now I can learn more about it and figure out what is the best. This is clear that they have blocked ips from Kenya, although they have claimed they do not do that, and we paid almost 100usd for the plugin
Thank you very much Lewis!
-
Hi Iris,
Yes, you want the URLs to be included in the sitemap too as this is what the search engines will use to build a map of your website and list them in their search engines.
With regards to your duplicate page issue, this is to do with your pagination of the pages. There's a guide here which tells you the SEO best practices when it comes to handling pagination, so hopefully this will help - http://searchengineland.com/the-latest-greatest-on-seo-pagination-114284
Really, you don't want those additional pages to be picked up in the search engines, so a fix will need to be sorted for that. You'll probably need to find a developer / a plugin to allow you to not index the /2 /3 pages etc.
I don't do much work with Wordpress, so maybe someone else could advise you with regards to the archive section. If your categories and posts are indexed, then I would have thought that you've done the correct thing with the archives and set them to noindex. That being said, I have limited knowledge of carrying out SEO for wordpress so I would need to take a closer look into that to give you a better response..
Hope this helps at least a little!
On a separate note, you could try accessing the Yoast website through a proxy such as http://hidemyass.com/ - Might be worth a go?
-
You are amazing Lewis, thank you so much for your time. The posts in categories are displayed only with short summary, so I guess it should be alright then. Should they also be all included in the sitemap? I am very scared of duplicate content.
Also every category has approximately 3 pages and now the moz crawl shows me that I have duplicate pages like this below and that it does not know which one is canonical:
I am not sure how to sort this out.
I have there also some archive post which says under: "Note: instead of templates these are the actual titles and meta descriptions for these custom post type archive pages."
I set the archives on noindex as i do not want the archives with post shoved in search result, but the categories. I hope this is correct. There are also some options and media, oh my god it's killing me:-( I have no idea what it is.
The reason why I am so annoying with this is that I can't access yoast site, his support team is looking into it why, but did not get back to me yet:-( I guess they have blocked ips from Kenya although they said me they don't do this.
Thank you very much Lewis for all you have done for me already!
-
I'm not sure if I fully understand your question, but I'll give it my best shot to answer it.
If I was in your position, I would set the Yoast plugin to index both the categories and the posts, but make sure that the posts only show a short summary / the first 'x' number of words than the post. The reason behind doing this is similar to how an ecommerce store works.
On eCommerce stores, you have your categories which are used as funnels to find inner product pages. Categories are generally set to be indexed as they combine lots of relevant data for a user which helps create a better user experience. In your case, your category may be 'Villas' and inside that, you may list 20 individual Villas. If you didn't have your category pages indexed, you'd be relying on the search engine to filter a user down to either your homepage or one specific villa which you hope is right for the users choice (which most likely will result in a higher bounce rate).
Again, I'm not sure if I've understood exactly what you're looking for, but that's what I would recommend if you're asking which sections of your site should be indexed. Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Getting Google to index our sitemap
Hi, We have a sitemap on AWS that is retrievable via a url that looks like ours http://sitemap.shipindex.org/sitemap.xml. We have notified Google it exists and it found our 700k urls (we are a database of ship citations with unique urls). However, it will not index them. It has been weeks and nothing. The weird part is that it did do some of them before, it said so, about 26k. Then it said 0. Now that I have redone the sitemap, I can't get google to look at it and I have no idea why. This is really important to us, as we want not just general keywords to find our front page, but we also want specific ship names to show links to us in results. Does anyone have any clues as to how to get Google's attention and index our sitemap? Or even just crawl more of our site? It has done 35k pages crawling, but stopped.
Intermediate & Advanced SEO | | shipindex0 -
Why Is this page de-indexed?
I have dropped out for all my first page KWDs for this page https://www.key.co.uk/en/key/dollies-load-movers-door-skates Can anyone see an issue? I am trying to find one.... We did just migrate to HTTPS but other areas have no problem
Intermediate & Advanced SEO | | BeckyKey0 -
Category Page as Shopping Aggregator Page
Hi, I have been reviewing the info from Google on structured data for products and started to ponder.
Intermediate & Advanced SEO | | Alexcox6
https://developers.google.com/search/docs/data-types/products Here is the scenario.
You have a Category Page and it lists 8 products, each products shows an image, price and review rating. As the individual products pages are already marked up they display Rich Snippets in the serps.
I wonder how do we get the rich snippets for the category page. Now Google suggest a markup for shopping aggregator pages that lists a single product, along with information about different sellers offering that product but nothing for categories. My ponder is this, Can we use the shopping aggregator markup for category pages to achieve the coveted rich results (from and to price, average reviews)? Keen to hear from anyone who has had any thoughts on the matter or had already tried this.0 -
Staging/Development Site Indexed?
So, my company's site has been pretty tough to try to get moving in the right direction on Google's SERPs. I had believed that it was mainly due to having a shortage of back links and a horrible home page load time. Everything else seems to be set up pretty well. I was messing around and used the site: Google search operator for our staging site. I found stage.site.com and a lot of our other staging pages in the search results. I have to think that this is the problem and causing a duplicate content penalty of the entire site. I guess I now need to 301 redirect the entire site? Has anyone every had this issue before and have fixed it? Thanks for any help.
Intermediate & Advanced SEO | | aua0 -
Image Sitemap for non indexed Products
Hi, we have several ecommerce sites. We want to do an image sitemap, as we have lots of attractive images. The question is, can you put images for non-indexed products there as well, or does that conflict with the normal sitemap (the images would be indexed, the products not)? Thanks in advance. Dieter Lang
Intermediate & Advanced SEO | | Storesco0 -
What would cause the wrong category page to come up?
I am trying to figure out why the wrong thing is coming up in the serps. For example, we are trying to rank for used widgets. But when you type in used widgets in google the primary widget page doesn't come up, one of the secondary categories under used widgets comes up. What would cause this? What are things I should check?
Intermediate & Advanced SEO | | EcommerceSite0 -
How do you de-index and prevent indexation of a whole domain?
I have parts of an online portal displaying in SERPs which it definitely shouldn't be. It's due to thoughtless developers but I need to have the whole portal's domain de-indexed and prevented from future indexing. I'm not too tech savvy but how is this achieved? No index? Robots? thanks
Intermediate & Advanced SEO | | Martin_S0 -
Best Product URL For Indexing
My proposed URL: mydomain.com/products/category/subcategory/product detail Puts my products 4 levels deep. Is this too deep to get my products indexed?
Intermediate & Advanced SEO | | waynekolenchuk0