Index or not index Categories
-
We are using Yoast Seo plugin. On the main menu we have only categories which has consist of posts and one page. We have category with villas, category with villa hotels etc.
Initially we set to index and include in the sitemap posts and excluded categories, but I guess it was not correct.
Would be a better way to index and include categories in the sitemap and exclude the posts in order to avoid the duplicate? It somehow does not make sense for me, If the posts are excluded and the categories included, will not then be the categories empty for google? I guess I will get crazy of this.
Somebody has perhaps more experiences with this?
-
No problem at all, glad I could help!
Good luck with the site!
-
You are really amazing Lewis! I understand what you mean with no indexing the pages 2, 3 etc..Yoast has there such option that I can mark it and it will not be indexing them.
Thank you so much for the tool you gave me to visit yoast site!!! It worked! Now I can learn more about it and figure out what is the best. This is clear that they have blocked ips from Kenya, although they have claimed they do not do that, and we paid almost 100usd for the plugin
Thank you very much Lewis!
-
Hi Iris,
Yes, you want the URLs to be included in the sitemap too as this is what the search engines will use to build a map of your website and list them in their search engines.
With regards to your duplicate page issue, this is to do with your pagination of the pages. There's a guide here which tells you the SEO best practices when it comes to handling pagination, so hopefully this will help - http://searchengineland.com/the-latest-greatest-on-seo-pagination-114284
Really, you don't want those additional pages to be picked up in the search engines, so a fix will need to be sorted for that. You'll probably need to find a developer / a plugin to allow you to not index the /2 /3 pages etc.
I don't do much work with Wordpress, so maybe someone else could advise you with regards to the archive section. If your categories and posts are indexed, then I would have thought that you've done the correct thing with the archives and set them to noindex. That being said, I have limited knowledge of carrying out SEO for wordpress so I would need to take a closer look into that to give you a better response..
Hope this helps at least a little!
On a separate note, you could try accessing the Yoast website through a proxy such as http://hidemyass.com/ - Might be worth a go?
-
You are amazing Lewis, thank you so much for your time. The posts in categories are displayed only with short summary, so I guess it should be alright then. Should they also be all included in the sitemap? I am very scared of duplicate content.
Also every category has approximately 3 pages and now the moz crawl shows me that I have duplicate pages like this below and that it does not know which one is canonical:
I am not sure how to sort this out.
I have there also some archive post which says under: "Note: instead of templates these are the actual titles and meta descriptions for these custom post type archive pages."
I set the archives on noindex as i do not want the archives with post shoved in search result, but the categories. I hope this is correct. There are also some options and media, oh my god it's killing me:-( I have no idea what it is.
The reason why I am so annoying with this is that I can't access yoast site, his support team is looking into it why, but did not get back to me yet:-( I guess they have blocked ips from Kenya although they said me they don't do this.
Thank you very much Lewis for all you have done for me already!
-
I'm not sure if I fully understand your question, but I'll give it my best shot to answer it.
If I was in your position, I would set the Yoast plugin to index both the categories and the posts, but make sure that the posts only show a short summary / the first 'x' number of words than the post. The reason behind doing this is similar to how an ecommerce store works.
On eCommerce stores, you have your categories which are used as funnels to find inner product pages. Categories are generally set to be indexed as they combine lots of relevant data for a user which helps create a better user experience. In your case, your category may be 'Villas' and inside that, you may list 20 individual Villas. If you didn't have your category pages indexed, you'd be relying on the search engine to filter a user down to either your homepage or one specific villa which you hope is right for the users choice (which most likely will result in a higher bounce rate).
Again, I'm not sure if I've understood exactly what you're looking for, but that's what I would recommend if you're asking which sections of your site should be indexed. Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
No Index thousands of thin content pages?
Hello all! I'm working on a site that features a service marketed to community leaders that allows the citizens of that community log 311 type issues such as potholes, broken streetlights, etc. The "marketing" front of the site is 10-12 pages of content to be optimized for the community leader searchers however, as you can imagine there are thousands and thousands of pages of one or two line complaints such as, "There is a pothole on Main St. and 3rd." These complaint pages are not about the service, and I'm thinking not helpful to my end goal of gaining awareness of the service through search for the community leaders. Community leaders are searching for "311 request service", not "potholes on main street". Should all of these "complaint" pages be NOINDEX'd? What if there are a number of quality links pointing to the complaint pages? Do I have to worry about losing Domain Authority if I do NOINDEX them? Thanks for any input. Ken
Intermediate & Advanced SEO | | KenSchaefer0 -
Removing index.php
I have question for the community and whether or not this is a good or bad idea. I currently have a Joomla site that displays www.domain.com/index.php in all the URLs with the exception of the home page. I have read that it's better to not have index.php showing in the URL at all. Does it really matter if I have index.php in my URL? I've read that it is a bad practice. I am thinking about installing the sh404SEF component on my site and removing the index.php. However, I rank pretty high for the keywords I want in Google, Bing and Yahoo. All of the URLs that show up in the searches have index.php as part of the URL. Has anyone ever used sh404SEF to remove the index.php and how did you overcome not loosing your search engine links? I don't want an existing search showing www.domain.com/index.php/sales and it not linking to the correct page which would now be www.domain.com/sales. I guess I could insert the proper redirects in the htaccess file. But I was hoping to avoid having every page of my site in the htaccess file for redirecting. Any help or advice appreciated.
Intermediate & Advanced SEO | | MedGroupMedia0 -
Why would one of our section pages NOT be indexed by Google?
One of our higher traffic section pages is not being indexed by Google. The products that reside on this section page ARE indexed by Google and are on page 1. So why wouldn't the section page be even listed and indexed? The meta title is accurate, meta description is good. I haven't received any notices in Webmaster Tools. Is there a way to check to see if OTHER pages might also not be indexed? What should a small ecom site do to see about getting it listed? SOS in Modesto. Ron
Intermediate & Advanced SEO | | yatesandcojewelers0 -
XML Sitemap Indexation Rate Decrease
On September 28th, 2013 I saw my indexation rate decrease on my XML sitemap that I've submitted through GWT. I've since scraped my sitemap and removed all 404, 400 errors (which only made up ~5% of the entire sitemap). Any idea why Google randomly started indexing less of my XML sitemap on that date? I updated my sitemap 2 week before that date and had an indexation rate of ~85% - no I'm below 35%. Thoughts, idea, experiences? Thanks!
Intermediate & Advanced SEO | | RobbieWilliams0 -
Indexing falling/search queries the same - concerned
Hello, I posted abou this a few days ago but didn't really get anywhere and now have new information after looking into it more. This is my site - http://www.whosjack.org My page indexing has been falling steadily daily currently from thousands of pages indexed to just a couple of hundred. My search queries don't seem to be currently affected, I have done crawl tests to see if the site can be crawled and put the site:whosjack.org into Google and had 12,000 results come back when goole has said it has indexed 133 and falling. However all pages indexed on the site:whosjack.org search seem to be stories with just two words in the title? I am sure I am missing out on traffic here but can't work out what the issue is and how to fix it. I have no alerts on my dashboard and when I submit sitemaps to webmaster tools I get 15,115 URLs submitted 12,088 URLs indexedwhich cant be bad?Any help/suggestions really appreciated.
Intermediate & Advanced SEO | | luwhosjack0 -
Language Subdirectory homepage not indexed by Google
Hi mozzers, Our Spanish homepage doesn't seem to be indexed or cached in Google, despite being online for over a month or two. All Spanish subpages are indexed and have started to rank but not the homepage. I have submitted sitemap xml to GWTools and have checked there's no noindex on the page - it seems to be in order. And when I run site: command in Google it shows all pages except homepage. What could be the problem? Here's the page: http://www.bosphorusyacht.com/es/
Intermediate & Advanced SEO | | emerald0 -
Why do my https pages index while noindexed?
I have some tag pages on one of my sites that I meta noindexed. This worked for the http version, which they are canonical'd to but now the https:// version is indexing. The https version is both noindexed and has a canonical to the http version, but they still show up! I even have wordpress set up to redirect all https: to http! For some reason these pages are STILL showing in the SERPS though. Any experience or advice would be greatly appreciated. Example page: https://www.michaelpadway.com/tag/insurance-coverage/ Thanks all!
Intermediate & Advanced SEO | | MarloSchneider0 -
Is there a negative effect to show categories and products on the same page?
I mean having say 5 different categories on a page and showing the products that are in those categories below the categories. Just In case people don't want to dig deeper to find there product because they know what they need already. I would also want those categories for the people that need to do a little more searching and have a better reference guide. So is there any negatives to my SEO doing it that way?
Intermediate & Advanced SEO | | Mike.Bean0