No Index help
-
Hi, I have alot of notices about webpages that are apparently blocked by no index robots, I look through the code on the site and cannot see any coding for this and am confused how to fix the problem. Help anyone?
-
Thanks for your great help Sha!
-
Hi Steven,
There are two different robot related warnings in your SEOmoz PRO App report. The second one refers to pages or directories blocked by a disallow statement in a robots.txt file.
Next step is to check whether you have a robots.txt file in place for your site and if so, then check to see if there are files or directories disallowed in the file.
If the robots.txt file is not an issue, then the your best course of action is to email the SEOmoz Help team direct - help [at] seomoz.org. Give them the details of your campaign and explain the problem and they will take a look at it for you.
Hope that helps,
Sha
-
Thanks for you reply! I have looked at the meta tags and there is no meta noindex tag, this is where i am getting confused on how to make the page an indexed one? I would expect to see either of the meta tags you displayed earlier however they are not there? Thanks
-
Hi Steven,
This message refers to a meta tag which appears in the head statement for the page.
the code looks like this:
OR
This tag tells crawlers not to index the page (or to remove the page from the index if it already appears there) and to either follow or not follow links on the page.
In most cases I would use noindex, follow as this allows any link juice being passed to the page to flow on through the site. The meta noindex tag is the most reliable way to ensure that pages are not indexed since it occurs at the page level. Other methods such as disallowing pages in a robots.txt file can be unreliable as crawlers that come to a page via an external link do not see the disallow statement, so will index the page.
The noindex tags on your pages may have been placed in order to exclude pages that were producing errors or are duplicates of other pages.
Hope that helps,
Sha
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
We´re in trouble with our on site internal link optimization - please help
Dear Moz community, We have made a great mistake. Looking at keyword search volumes somehow Moz showed volumes for two keywords which only differentiate by an '**s (plural) as same. **Now we optimized our internal links (all links have the keyword) for the singular word. Now looking at other search volume estimations from competitors we see, that the plural has 5 times bigger volume. Our issue: If we change some of the category links now to another keyword, we will loose our ranking with the singular word. Correct? If we do not change any of our internal links, we will never rank in top 6 with the keyword. (currently singular is 6 and plural is 15) What would you reccomend?
On-Page Optimization | | advertisingcloud0 -
Project Help
Hi guys, I'm working on a project and I need to identify any on-site issues that may be affecting this website: http://www.jerseystamps.com/ If anyone has any thoughts, I would be more than happy to hear them. Thanks guys 🙂
On-Page Optimization | | AAttias0 -
Sitemap include all site links or just ones we want indexed?
Got a quick sitemap question. We have a clients site built in opencart and are getting ready to submit the sitmap. The default sitemap setting generates urls right off of the root. For example site.com/product. These urls are also accessible through the site itself. We prefer to give the site some depth and have structured the products so the urls are site.com/category/product. All of the product pages have canonicals including the category so we should not have to worry about duplicate content on the /product page vs the /category/product page. My question is both types of product pages are included in the sitemap at the moment. Since we don't want google to index the /product urls should we leave them off of the sitemap even though they are readily accessible from the frontend(though not linked)? Or just leave them and let the canonical tag be used in directing google as to which urls to index. Thanks in advance.
On-Page Optimization | | Whebb0 -
Index.php getting Duplicate page content.
I am quite new to SEO and have now got my first results. I am getting all my index.php pages returned as Duplicate page content. ie: blue-widgets/index.php
On-Page Optimization | | ivoryred
blue-widgets/ green-widgets/large/index.php
green-widgets/large/ How do solve this issue?0 -
Does adding ™ help or hurt?
I have a client who rents kids' party products that are branded (Batman, Curious George, etc.) Does it help or hurt to put the superscript "TM" in the Meta Title, or other meta or actual content of their product listings? I have some guesses, but am curious for other opinions / data! Thanks very much!
On-Page Optimization | | measurableROI0 -
Canonical tag help
Hi, We have a product which is marketed by affiliates . Affiliates send referrals to our sale page by adding their affiliate IDs to our product page like http://www.mysite.com/products.php?ref= 12345. We want to avoid the content duplication impression to Google by using canonical tags but we are not clear about its use. Should we use it on http://www.mysite.com/products.php ( actual page) or we should create temporary pages for each referral id i.e http://www.mysite.com/products.php?ref= 12345 and then add canonical tags to all those pages linking to proper page i.e http://www.mysite.com/products.php ? Thanks, shaz
On-Page Optimization | | shaz_lhr0 -
Dropped rankings due to too many links, help needed
We have just re-designed our site and added a big drop-down navigation menu to help users get straight to the category/sub-category they are looking for, take a look at http://www.discountfiresupplies.co.uk to see what I mean. Since doing so our rankings have dropped which we've been told may be because there are now so many links on (particularly) the home page diluting the rankings of that page. We've been advised that if we hide the drop-down menus using "style='display: none'" until they are required that the search engines will ignore them which we have now done but is this correct or will they still be indexed? And if so do you have any other suggestions? Thanks, Tariq
On-Page Optimization | | tjhossy0 -
Will a "no follow" "no index" meta tag resolve duplicate content issue?
I have a duplicate content issue. If the page has already been indexed will a no follow no index tag resolve the issue or do I also need a rel canonical statement?
On-Page Optimization | | McKeeMarketing0