Index or not index Categories
-
We are using Yoast Seo plugin. On the main menu we have only categories which has consist of posts and one page. We have category with villas, category with villa hotels etc.
Initially we set to index and include in the sitemap posts and excluded categories, but I guess it was not correct.
Would be a better way to index and include categories in the sitemap and exclude the posts in order to avoid the duplicate? It somehow does not make sense for me, If the posts are excluded and the categories included, will not then be the categories empty for google? I guess I will get crazy of this.
Somebody has perhaps more experiences with this?
-
No problem at all, glad I could help!
Good luck with the site!
-
You are really amazing Lewis! I understand what you mean with no indexing the pages 2, 3 etc..Yoast has there such option that I can mark it and it will not be indexing them.
Thank you so much for the tool you gave me to visit yoast site!!! It worked! Now I can learn more about it and figure out what is the best. This is clear that they have blocked ips from Kenya, although they have claimed they do not do that, and we paid almost 100usd for the plugin
Thank you very much Lewis!
-
Hi Iris,
Yes, you want the URLs to be included in the sitemap too as this is what the search engines will use to build a map of your website and list them in their search engines.
With regards to your duplicate page issue, this is to do with your pagination of the pages. There's a guide here which tells you the SEO best practices when it comes to handling pagination, so hopefully this will help - http://searchengineland.com/the-latest-greatest-on-seo-pagination-114284
Really, you don't want those additional pages to be picked up in the search engines, so a fix will need to be sorted for that. You'll probably need to find a developer / a plugin to allow you to not index the /2 /3 pages etc.
I don't do much work with Wordpress, so maybe someone else could advise you with regards to the archive section. If your categories and posts are indexed, then I would have thought that you've done the correct thing with the archives and set them to noindex. That being said, I have limited knowledge of carrying out SEO for wordpress so I would need to take a closer look into that to give you a better response..
Hope this helps at least a little!
On a separate note, you could try accessing the Yoast website through a proxy such as http://hidemyass.com/ - Might be worth a go?
-
You are amazing Lewis, thank you so much for your time. The posts in categories are displayed only with short summary, so I guess it should be alright then. Should they also be all included in the sitemap? I am very scared of duplicate content.
Also every category has approximately 3 pages and now the moz crawl shows me that I have duplicate pages like this below and that it does not know which one is canonical:
I am not sure how to sort this out.
I have there also some archive post which says under: "Note: instead of templates these are the actual titles and meta descriptions for these custom post type archive pages."
I set the archives on noindex as i do not want the archives with post shoved in search result, but the categories. I hope this is correct. There are also some options and media, oh my god it's killing me:-( I have no idea what it is.
The reason why I am so annoying with this is that I can't access yoast site, his support team is looking into it why, but did not get back to me yet:-( I guess they have blocked ips from Kenya although they said me they don't do this.
Thank you very much Lewis for all you have done for me already!
-
I'm not sure if I fully understand your question, but I'll give it my best shot to answer it.
If I was in your position, I would set the Yoast plugin to index both the categories and the posts, but make sure that the posts only show a short summary / the first 'x' number of words than the post. The reason behind doing this is similar to how an ecommerce store works.
On eCommerce stores, you have your categories which are used as funnels to find inner product pages. Categories are generally set to be indexed as they combine lots of relevant data for a user which helps create a better user experience. In your case, your category may be 'Villas' and inside that, you may list 20 individual Villas. If you didn't have your category pages indexed, you'd be relying on the search engine to filter a user down to either your homepage or one specific villa which you hope is right for the users choice (which most likely will result in a higher bounce rate).
Again, I'm not sure if I've understood exactly what you're looking for, but that's what I would recommend if you're asking which sections of your site should be indexed. Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why do I have so many extra indexed pages?
Stats- Webmaster Tools Indexed Pages- 96,995 Site: Search- 97,800 Pages Sitemap Submitted- 18,832 Sitemap Indexed- 9,746 I went through the search results through page 28 and every item it showed was correct. How do I figure out where these extra 80,000 items are coming from? I tried crawling the site with screaming frog awhile back but it locked because of so many urls. The site is a Magento site so there are a million urls, but I checked and all of the canonicals are setup properly. Where should I start looking?
Intermediate & Advanced SEO | | Tylerj0 -
Https & http urls in Google Index
Hi everyone, this question is a two parter: I am now working for a large website - over 500k monthly organic traffic. The site currently has both http and https urls in Google's index. The website has not formally converted to https. The https began with an error and has evolved unchecked over time. Both versions of the site (http & https) are registered in webmaster tools so I can clearly track and see that as time passes http indexation is decreasing and https has been increasing. The ratio is at about 3:1 in favor of https at this time. Traffic over the last year has slowly dipped, however, over the last two months there has been a steady decline in overall visits registered through analytics. No single page appears to be the culprit, this decline is occurring across most pages of the website, pages which traditionally draw heavy traffic - including the home page. Considering that Google is giving priority to https pages, could it be possible that the split is having a negative impact on traffic as rankings sway? Additionally, mobile activity for the site has steadily increased both from a traffic and a conversion standpoint. However that traffic has also dipped significantly over the last two months. Looking at Google's mobile usability error's page I see a significant number of errors (over 1k). I know Google has been testing and changing mobile ranking factors, is it safe to posit that this could be having an impact on mobile traffic? The traffic declines are 9-10% MOM. Thank you. ~Geo
Intermediate & Advanced SEO | | Geosem0 -
Certain Product Pages Not Indexing
Hey All, We discovered an issue where new product pages on our site were not getting indexed because a "noindex" tag was inadvertently being added to section when those pages were created. We removed the noindex tag in late April and some of the pages that had not been previously indexed are now showing up, but others are still not getting indexed and I'd appreciate some help on why this could be. Here is an example of a page that was not in the index but is now showing after removal of noindex: http://www.cloud9living.com/san-diego/gaslamp-quarter-food-tour And here is an example of a page that is still not showing in the index: http://www.cloud9living.com/atlanta/race-a-ferrari UPDATE: The above page is now showing after I manually submitted it in WMT. I had previously submitted another page like a month ago and it was still not indexing so I thought the manual submission was a dead end. However, it just so happens that the above URL just had its Page Title and H1 updated to something more specific and less duplicative so I am currently running a test to see if that's the problem with these pages not indexing. Will update this soon. Any suggestions? Thanks!
Intermediate & Advanced SEO | | GManSEO0 -
Cross linking between categories
Is it useful for SEO to cross link between TOP level categories, let's say I have a Home page and then 2 sub categories, one about green widgets one about red widgets
Intermediate & Advanced SEO | | seoanalytics
Should i create a link from the green widget to the red widget or should I leave those are separate silos ? I know that within a silo i need to cross link ( from green widget 1 to green widget 2 etc... ) but how about about from the main category to the other main category ?0 -
Internal linking between categories
Is it necessary to do internal links between the same categories of a website ( Let's say Ihave a category about shoes and in the category I have a page about boots and one about sandals ( should the page boots be accessible from the page sandals and the other way round or is the back button going back to the section shoes enough ) ? If internal links between the same category ( sandals to boots ) are needed/recommended is it also a good practice to do site wide links between categories ( shoes and and bags for example ) Because by reading google recommendations "Make a site with a clear hierarchy and text links. Every page should be reachable from at least one static text link" I am not sure if they are talking about breadcrumbs or text links i am kind of lost ... Thank you,
Intermediate & Advanced SEO | | seoanalytics0 -
Changing a parent category and 301 redirecting
I have a set of three pages that are subpages of a parent. The structure is as follows: mysite.com/directory/personal-widgets mysite.com/directory/commercial-widgets mysite.com/directory/widgets-services The partent page name "directory" really isn't working for where I want these pages to evolve. So I want to change it to "guides" In a world without worrying about google, I would simply change the parent page to guides, so they look like this, and be done with it: mysite.com/guides/personal-widgets But, the obvious problem is that I have external links to the page now. And the pages have a nice PR. And they also have Facebook page Likes and I don't know if I'll lose those. I know that if I should do this I should redirect the pages to the new pages of course. My question is: Will redirecting the old URL to the new URL with a 301 cause anything negative to happen that I might not be expecting? Does Google dislike Redirects for any reason, or understand they are sometimes necessary?
Intermediate & Advanced SEO | | bizzer0 -
Few questions regarding wordpress and indexing/no follow.
I'm using Yoast's Wordpress SEO plugin on my wordpress site which allows you to quickly set up nofollow / no index on specific taxonomies. I wanted to see what you guys thought was the best practice in setting up my various taxonomies. Would you noidex, but follow all of these, none of these, or just some of these: Categories, tags, media, author archives ( (My blog is mainly a single author blog (me) but my wife does sometimes write posts. So I didn't know how this effected everything. Also I could simply make the blog a single user blog and just have her posts be guest posts, but I'd rather leave her as a user.), and date archives. The example I read on line only no-index's the date archives. Just curious what you guys thought. Thanks.
Intermediate & Advanced SEO | | NoahsDad0 -
Sitemap - % of URL's in Google Index?
What is the average % of links from a sitemap that are included in the Google index? Obviously want to aim for 100% of the sitemap urls to be indexed, is this realistic?
Intermediate & Advanced SEO | | stats440