Blocked by Meta Robots.
-
Hi,
I get this warning on my reporting.
- Blocked by Meta Robots - This page is being kept out of the search engine indexes by meta-robots.
what does that means ? and how to solve that, if i using wordpress as my website engine.
and about rel=canonical , in which page I should put this tag, in original page, or in copy page ?
thanks for all of your answer, it will be means a lot
-
There are wordpress plugins you can use to modify your robots.txt, wordpress makes it difficult.
http://yoast.com/example-robots-txt-wordpress/
Also, make sure it is an important page for your blog- Google is just being proactive on your behalf, it might be an irrelevant page to your overall plan.
-
Actually it would not be in the meta robots noindex. The meta tag does not prevent Google from crawling the page it is on. If it did that, then Google would not be able to crawl the page and then it would not be able to read the tag :-). The meta robots will tell Google to remove the page from the index and so it is very effective for that application.
That said, the GWT warning, is probably related to you robots.txt file located at
http://www.yourdomain.ext/robots.txt
Put that in your browser and see if you have any of your files, pages Disallowed in that file. If that is the case, then Google will not be able to spider a page to start with, let alone read the meta tags. Do some searching on Google on how robots.txt works Moz obviously has one
http://moz.com/learn/seo/robotstxt
Here is a video on how to use Wordpress and robot.txt - it may or may not relate to your config, but will show a plugin that you can use to adjust
http://www.youtube.com/watch?v=JY9A5OqHTvw
You can figure out how to understand it and then what you need to update it. Get with your IT person or whoever admins your site
-
It means there is a meta tag on the page that is blocking the page. Look in the head section of the page for a tag. Remove this and you should be good to go. Check your WordPress settings, sometimes these tags are automatically assigned to pages as a default. You could also download a SEO plug in to help manage the meta robots tags.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Spammy Directories Using Title Meta-Tag For Link
I've been noticing a growing amount of spammy directories using my title Meta-Tag to create a link back to my site. Since my title uses competitive keywords, these external links on spammy directories look over optimized and I fear an algo penalty might get triggered. Should I be concerned and what can I do?
Moz Pro | | alrockn0 -
Moz says I am missing titles and meta tags and have duplicate content
I just redesigned my website and suddenly traffic has dropped. Moz says I am missing titles, meta tag descriptions and have a lot of duplicate content. My site is http://skigenie.com and is full of unique and hand written content,. Are there any wordpress plugins that will add titles etc to my pages (some of the added ones are custom)? Any help would be much appreciated!
Moz Pro | | flexy0 -
Is it possible to block Moz from crawling sites?
Hi, is it possible to stop Moz from crawling a site at the server level? Not that I am looking to do this or anything, but here's why I'm asking. I have been crawling a site that is managed (currently by 2 parties), and I noticed that this week pages crawled went from 80 (last week) to 1 page!! I know, what? See my image attached... and the issues all went to zero "0"....! So is it possible that someone can't prevent Moz from crawling the site at the server level? I checked the robots.txt file on the site, but nothing there. I'm curious. dYNUwjd.jpg
Moz Pro | | co.mc0 -
Experts solve some query related Title Tag, Meta Tag Description, Link Building, URL
Title Tag Question Short title tag is more useful so if we just use our targeted keyword in home page title then is it useful.? for example my website: http://www.topnotchlawsuitloans.com/ i am targeting lawsuit loans keyword so if i use <title>TNF - Lawsuit Loans | Lawsuit Funding</title> is batter to use for main page or <title>Lawsuit Loans | Lawsuit Funding | As Low As 1% | PreSettlement Funding</title> can we have to use main targeting keyword on all webpage title tag ? my website have 200+ page and i have to use different title tag for that pages including targated keyword so if i am targeting lawsuit loans in that title, what is best to divide title pipe, hyphen or comma ? does capitalization in title tag wrong effect ? Lawsuit Loans - As low as 1% Lawsuit Loans | As low as 1% Lawsuit Loans, As low as 1% (or i have to use smaller cash in title) for all different page i want to place this kind of title is it best for SEO purpose Lawsuit Loans - Lawsuit Loans Fargo Lawsuit Loans - Lawsuit Loans Escondido Lawsuit Loans - Lawsuit Loans Erie Lawsuit Loans - Lawsuit Loans Flint Lawsuit Loans - Lawsuit Loans Fort Wayne Lawsuit Loans - Lawsuit Loans Fresno Lawsuit Loans - Lawsuit Loans Gainesville Lawsuit Loans - Lawsuit Loans Grand Rapids Lawsuit Loans - Lawsuit Loans Gilbert Lawsuit Loans - Lawsuit Loans Gresham Lawsuit Loans - Lawsuit Loans High Point Lawsuit Loans - Lawsuit Loans Hialeah Lawsuit Loans - Lawsuit Loans Huntsville if i am using this kind of different title for all page then it can effective for SEO or it will be come in keyword stuffing Meta Tag Description can we add meta tag description like this i mean targeted keyword before the description start, is it useful or not? important Meta tags please visit my http://www.topnotchlawsuitloans.com/ and inform me what are the important meta tags, so i can remove other tags Link Building Question i want to get rank in google for www.topnotchlawsuitloans.com so have to build backlinks with lawsuit loans alt tag but main question is this have to build or gain backlinks for this domain only or one of my website sub domain www.topnotchlawsuitloans.com/lawsuit-funding-philadelphia.html on page #6 so have to build backlink for this URL ??? what are the effective strategy to gain backlinks for main page or all sub pages have to build backlinks ?? how many backlink per keyword & page is good for website. URL i have to use targeted keyword on all sub page domain or not for example now i am using url like this format fundingtype.html litigation-funding.html legal-funding.html financingservices.html process.html and if i re-write all url with targated keyword like this format lawsuit-loans-fundingtype.html lawsuit-loans-litigation-funding.html lawsuit-loans-legal-funding.html lawsuit-loans-financingservices.html lawsuit-loans-process.html so which type URL are more effective for best SEO ??
Moz Pro | | JulieWhite0 -
Does Rogerbot respect the robots.txt file for wildcards?
Hi All, Our robots.txt file has wildcards in it, which Googlebot recognizes. Can anyone tell me whether or not Rogerbot recognizes wildcards in the robots.txt file? We've done a Rogerbot site crawl since updating the robots.txt file and the pages that are set to disallow using the wildcards are still showing. BTW, Googlebot is not crawling these pages according to Webmaster Tools. Thanks in advance, Robert
Moz Pro | | AC_Pro0 -
Sites Blocking Open Site Explorer? Penguin related.
Last week I was looking at a competitors site who has a link scheme going on and I could actually check the links for each anchor text. This week they don't work at all, do you think they're blocking the rogerbot on their domains? Or is there a problem with open site explorer? http://www.opensiteexplorer.org/anchors?site=www.decks.ca If you're interested in the background, all the links are to instant-home-biz . com which then redirects decks . ca - it's a tricky technique. Pretty much all of the links are from sketchy sites like: airpr23.xelr8it.biz/ airpr23.anzaland.net/ airpr23.vacation-4-free.com/airpr23.blogfreeradio.net/airpr23.blogomatik.com/http://www.morcandirect.com/mortgages/resources2.php which I thought Penguin was supposed to catch…
Moz Pro | | BeTheBoss0 -
Linking C Blocks - SEOMoz says its a good thing?
In the competitve analysis, one competitor have more Linking C Blocks, Seomoz has a tick by it almost like its a better thing. Surely a site with the same administrative relationship is not going to help you as much from a linking point of view.
Moz Pro | | sanchez19600 -
Why does the crawl report say I should have meta description and title tags in my xml files?
Just had my first crawl report today which has been very useful in finding missing and duplicated title tags and meta descriptions but it has flagged up the fact that my xml files are missing these. Surely non HTML documents shouldn't have them (or need them) so why are they showing up in the report?
Moz Pro | | PandyLegend0