Warnings for blocked by blocked by meta-robots/meta robots Nofollow...how to resolve?
-
Hello,
I see hundreds of notices for blocked by meta-robots/meta robots nofollow and it appears it is linked to the comments on my site which I assume I would not want to be crawled. Is this the case and these notices are actually a positive thing? Please advise how to clear them up if these notices can be potentially harmful for my SEO.
Thanks,
Talia
-
The notices in the SEOmoz PRO platform are just that - notices. They are neither good nor bad in themselves, but we want you to be aware of them in case the issues are not supposed to be there.
In the case of comments such as yours, there are very legitimate reasons why you wouldn't want these crawled or indexed, depending on your situation (duplicate content issues, link to spam, etc) If you are aware why the issues are appearing, and comfortable with your reasoning, it's perfectly fine to have notices in your account.
-
If you are talking about Google Webmaster reporting that blog comments are blocked or no-followed, then yes, that is a good thing. Normally, it's a pretty good idea to make sure that any links that are added to blog comments are no-follow.
However, you do want to make sure that you are not blocking the blog post itself from being indexed or crawled. Just double-check the URL that Webmaster is reporting. If it's just for comment links, then your all good. If it's for the whole URL, then you might want to consider modifying your robots.txt file to make sure that your blog page is crawled but comment links are not.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to use robots.txt to block areas on page?
Hi, Across the categories/product pages on out site there are archives/shipping info section and the texts are always the same. Would this be treated as duplicated content and harmful for seo? How can I alter robots.txt to tell google not to crawl those particular text Thanks for any advice!
Technical SEO | | LauraHT0 -
All META descriptions gone
Hi there, Since almost a week now, all of my optmized META descriptions has been gone in Google. The last few years Google has always shown all of the optimized META descriptions. My website is an ecommerce site (phone accessories) and all pages have its own unique content (url, text, title, description) and score well in Google. The META descriptions are created by using a template like this: At [brandname] you find lots of [variable category product] * USP 1 * USP 2 * USP 3 All META descriptions differ from each other only by the variable category product. Something tells me this is an effect of the Panda 4.0 update. I tested with a category page by replacing the META description for a 100% unique one. Then I asked Google (via Webmaster tools) to reindex the page. Today the new description got indexed. This means uniqueness is important. My question is: how do I get the optimized META descriptions back? Creating real unique descriptions (means not using a template) for every page is very hard for a webhop since all category pages have the same message to tell (only difference is the type of product), I want to use USP's, and META descriptions of all productpages have been lost too (over 15000 different products). Please help!
Technical SEO | | MarcelMoz
Thanks in advance. Marcel0 -
Meta tags
Hello, Does anyone know how long it takes for the meta descriptions to show up in Google? This because I just updated my meta descriptions for the whole website, but while moz toolbar is showing it correctly, google is still showing the old ones, even if i used the see as googlebot tool from webmaster tools. Thanks for a reply
Technical SEO | | socialengaged
Eugenio | Social Engagement0 -
Miss meta description on 404 page
Hi, My 404 page did not have meta description. Is it an error? Because I run report and seomoz said that a problem. Thanks!
Technical SEO | | JohnHuynh0 -
Google insists robots.txt is blocking... but it isn't.
I recently launched a new website. During development, I'd enabled the option in WordPress to prevent search engines from indexing the site. When the site went public (over 24 hours ago), I cleared that option. At that point, I added a specific robots.txt file that only disallowed a couple directories of files. You can view the robots.txt at http://photogeardeals.com/robots.txt Google (via Webmaster tools) is insisting that my robots.txt file contains a "Disallow: /" on line 2 and that it's preventing Google from indexing the site and preventing me from submitting a sitemap. These errors are showing both in the sitemap section of Webmaster tools as well as the Blocked URLs section. Bing's webmaster tools are able to read the site and sitemap just fine. Any idea why Google insists I'm disallowing everything even after telling it to re-fetch?
Technical SEO | | ahockley0 -
Question about collapsible/Expandable
I will premise this question by saying I am not a developer, so please forgive my ignorance on this one. Is there a way to achieve an expandable/collapsible without relying on javascript? Thanks all! Dana
Technical SEO | | danatanseo0 -
I accidentally blocked Google with Robots.txt. What next?
Last week I uploaded my site and forgot to remove the robots.txt file with this text: User-agent: * Disallow: / I dropped from page 11 on my main keywords to past page 50. I caught it 2-3 days later and have now fixed it. I re-imported my site map with Webmaster Tools and I also did a Fetch as Google through Webmaster Tools. I tweeted out my URL to hopefully get Google to crawl it faster too. Webmaster Tools no longer says that the site is experiencing outages, but when I look at my blocked URLs it still says 249 are blocked. That's actually gone up since I made the fix. In the Google search results, it still no longer has my page title and the description still says "A description for this result is not available because of this site's robots.txt – learn more." How will this affect me long-term? When will I recover my rankings? Is there anything else I can do? Thanks for your input! www.decalsforthewall.com
Technical SEO | | Webmaster1230 -
Robots.txt questions...
All, My site is rather complicated, but I will try to break down my question as simply as possible. I have a robots.txt document in the root level of my site to disallow robot access to /_system/, my CMS. This looks like this: # /robots.txt file for http://webcrawler.com/
Technical SEO | | Horizon
# mail webmaster@webcrawler.com for constructive criticism **User-agent: ***
Disallow: /_system/ I have another robots.txt file in another level down, which is my holiday database - www.mysite.com/holiday-database/ - this is to disallow access to /holiday-database/ControlPanel/, my database CMS. This looks like this: **User-agent: ***
Disallow: /ControlPanel/ Am I correct in thinking that this file must also be in the root level, and not in the /holiday-database/ level? If so, should my new robots.txt file look like this: # /robots.txt file for http://webcrawler.com/
# mail webmaster@webcrawler.com for constructive criticism **User-agent: ***
Disallow: /_system/
Disallow: /holiday-database/ControlPanel/ Or, like this: # /robots.txt file for http://webcrawler.com/
# mail webmaster@webcrawler.com for constructive criticism **User-agent: ***
Disallow: /_system/
Disallow: /ControlPanel/ Thanks in advance. Matt0
