No Index help
-
Hi, I have alot of notices about webpages that are apparently blocked by no index robots, I look through the code on the site and cannot see any coding for this and am confused how to fix the problem. Help anyone?
-
Thanks for your great help Sha!
-
Hi Steven,
There are two different robot related warnings in your SEOmoz PRO App report. The second one refers to pages or directories blocked by a disallow statement in a robots.txt file.
Next step is to check whether you have a robots.txt file in place for your site and if so, then check to see if there are files or directories disallowed in the file.
If the robots.txt file is not an issue, then the your best course of action is to email the SEOmoz Help team direct - help [at] seomoz.org. Give them the details of your campaign and explain the problem and they will take a look at it for you.
Hope that helps,
Sha
-
Thanks for you reply! I have looked at the meta tags and there is no meta noindex tag, this is where i am getting confused on how to make the page an indexed one? I would expect to see either of the meta tags you displayed earlier however they are not there? Thanks
-
Hi Steven,
This message refers to a meta tag which appears in the head statement for the page.
the code looks like this:
OR
This tag tells crawlers not to index the page (or to remove the page from the index if it already appears there) and to either follow or not follow links on the page.
In most cases I would use noindex, follow as this allows any link juice being passed to the page to flow on through the site. The meta noindex tag is the most reliable way to ensure that pages are not indexed since it occurs at the page level. Other methods such as disallowing pages in a robots.txt file can be unreliable as crawlers that come to a page via an external link do not see the disallow statement, so will index the page.
The noindex tags on your pages may have been placed in order to exclude pages that were producing errors or are duplicates of other pages.
Hope that helps,
Sha
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website Not Indexing
My website is not indexing due to someone's complaint in Google that was registered in 2013. The complaint says I am using copyrighted images of someone else on my website but those images were immediately removed by me. I just came to know about this complaint and lodged my problem in Lumen database. Already 14 days has passed but still my page is not indexed. Can anyone please help me?
On-Page Optimization | | varun18000 -
Sitemap include all site links or just ones we want indexed?
Got a quick sitemap question. We have a clients site built in opencart and are getting ready to submit the sitmap. The default sitemap setting generates urls right off of the root. For example site.com/product. These urls are also accessible through the site itself. We prefer to give the site some depth and have structured the products so the urls are site.com/category/product. All of the product pages have canonicals including the category so we should not have to worry about duplicate content on the /product page vs the /category/product page. My question is both types of product pages are included in the sitemap at the moment. Since we don't want google to index the /product urls should we leave them off of the sitemap even though they are readily accessible from the frontend(though not linked)? Or just leave them and let the canonical tag be used in directing google as to which urls to index. Thanks in advance.
On-Page Optimization | | Whebb0 -
Wordpress photo blog with sparse text - noindex posts, index categories?
Hi everyone, I have a wordpress blog that is heavy on photos but short on text - most of my posts consist of a photo linking to a full gallery, and a short description of 1-4 sentences. I've often read recommendations to noindex category pages, but in this case I'm wondering if it might be best to noindex the individual posts instead - I'm concerned that the short posts might seem like thin content to Google compared to the category pages which aggregate the posts. Also, some of my categories reflect keywords that I'd like to rank well for. I have about a dozen categories and close to 1000 posts.
On-Page Optimization | | matt_b0 -
Need professional SEO help for onpage analysis and advice
Hi guys, I am not sure if here is the right place to ask for this, but we really need help with one of our projects, especially for the site analysis. We dont need link building tips etc, we just need help regarding our site structure, code etc etc. Do you have any ideas where I can find some real professionals on this topic? Thank you a lot !
On-Page Optimization | | commissionshare0 -
Boat broker - issues with duplicate content and indexing search results
Hello, I have read a lot about optimising product pages and not indexing search results or category pages as ideally a person should be directed straight to a product page. I am interested in how best to approach a site that is listing second hand products for sale - essentially a marketplace of second hand goods (in my case, www.boatshed.com - international boat brokers). For example, we currently have 5 Colvic Sailer 26 boats for sale across the world - that is 5 boats of the same make and model but differing years, locations, sellers and prices. My concern is with search results and 'category' pages. Unlike typical e-commerce sites, when someone searches for a 'Colvic sailer 26 for sale' I want them to go to a search results style page as it is more useful for them to see a list of boats than one random one that Google decides is most important (or possibly one it can match by location). Currently we have 3 different URL types to show search results style pages (i.e. paginated lists of boats that include name, image and short description):
On-Page Optimization | | pbscreative
manufacturer URL's e.g. http://www.boatshed.com/colvic-manufacturer-145.html
category URL's e.g. barges http://www.boatshed.com/barges-category-55.html
and normal search results e.g. dosearch.php?form_boattype_textbox=&.... I have noindexed the search results pages but our category and manufacturer URLs show up in search results and ultimately these are pages I want people to land on. I am however getting duplicate content warnings in Moz. Most boats are in several categories and all will come up on 1 manufacturer and one manufacturer and model page. Both sets of URL's are in my opinion needed; lots of users search for exact makes / models and lots of users just search for the type of boat e.g. 'barge for sale' so both sets of landing pages are useful. Any suggestions or thoughts greatly appreciated Thanks Ben0 -
Title Tags for Index Pages
What tactics do you use to change the title tags of your index page so they're not all the same? For example, if you have an index page that has 100 pages, each with the same title, what tactics do you use to give each page a unique title and how important is it?
On-Page Optimization | | felt0 -
Disqus Comments or IntenseDebate for eCommerce. Can It HELP???
Anybody using any of those? Do you have example of eCommerce store using it? Will it help ranking? Any thing I should know about those ''Comments'' plug-in? Thank you, BigBlaze
On-Page Optimization | | BigBlaze2050 -
SEO Issues with Avactis Shopping Cart Please Help
The home page title duplicates on all cms pages. this is causing the title to be over 70 characters. This is my first experience with Avactis so I am not exactly sure how to handle. Does anyone know?
On-Page Optimization | | MACameron0