What does the blocking_google property in the CSV export mean, and what to do about it?
-
The CSV export for Crawl Diagnostics contains a column named "blocked_google". It states a blocking date/time but doesn't occur on all our webpages, not even on all pages of the same type / structure.
There are no other flags on these records that would explain a blocking of Google; all other agents are not flagged, and our robots.txt doesn't contain any blocks either. The only flag the records have in common is "Page Title > 70 characters". Of course, I could just assume this is the reason for the "blocking_google", but is it?
What evaluation makes the crawler fill in this property, and how to handle/solve it's occurrence?
-
that page seem fine, and it also indexed by google, so I'm not sure whats the story with that. Might be best to contact seomoz support (help@moz.com I think)
-
Thank you again for your response.
The following link forwards to one of the affected pages: http://bit.ly/1b3IVYB
I'm downloading Screeming Frog right now and give it a try, thank you for the advice.
-
can you give an example of one of the pages the is "blocked_google"
Btw try screeming frog ( you can do 500 pages for free), it should pick up the same error and might explain why.
-
Thank you for your response.
Our CMS generates the following meta-tags on the affected pages:
Pragma is for cache control, content-type and google verification are clear. P: is Pinterest Social media, the rest is standard again. I searched the source of the page for "robots" as well, but no results.
-
check that those pages don't have some like:
meta name="robots" content="NOINDEX,NOFOLLOW" />
in the source code
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
If Google's index contains multiple URLs for my homepage, does that mean the canonical tag is not working?
I have a site which is using canonical tags on all pages, however not all duplicate versions of the homepage are 301'd due to a limitation in the hosting platform. So some site visitors get www.example.com/default.aspx while others just get www.example.com. I can see the correct canonical tag on the source code of both versions of this homepage, but when I search Google for the specific URL "www.example.com/default.aspx" I see that they've indexed that specific URL as well as the "clean" one. Is this a concern... shouldn't Google only show me the clean URL?
Technical SEO | | JMagary0 -
Is it possible to export Inbound Links in a CSV file categorized by Linking Root Domains ?
Hi, I am performing an analysis of the total inbound links to my homepage and I would like to have the total amount of inbound links categorized by the Linking root domains. For example, the Open Site explorer does offer the feature to show you the Linking Root Domains to your page. Then when you click on the first Linking Root Domain, it also shows you the Top Linking Pages ( Which means all the pages that link to your page from this particular top level domain) Now I would like to export this data to a CSV file, but open site explorer only exports the total amount of top level linking domains. Does anyone has a solution to this problem ? Thank you very much for the help in advance!
Technical SEO | | Feweb0 -
Server is taking too long to respond - What does this mean?
A client has 3 sites that he would like for me to look at. Whenever I attempt to on my home internet I get this message: The connection has timed out
Technical SEO | | columbiaseo
The server is taking too long to respond. When I take my iphone off wifi and use AT&T, the site comes up fine. What is going on here?0 -
Rel="Follow"? What the &#@? does that mean?
I've written a guest blog post for a site. In the link back to my site they've put a rel="follow" attribute. Is that valid HTML? I've Googled it but the answers are inconclusive, to say the least.
Technical SEO | | Jeepster0 -
If my home page never shows up in SERPS but other pages do, does that mean Google is penalizing me?
So my website I do local SEO for, xyz.com is finally getting better on some keywords (Thanks SEOMOZ) But only pages that are like this xyz.com/better_widgets_ or xyz.com/mousetrap_removals Is Google penalizing me possibly for some duplicate content websites I have out there (working on, I know I know it is bad)...
Technical SEO | | greenhornet770 -
Campaign Issue: Rel Canonical - Does this mean it should be "on" or "off?"
Hello, somewhat new to the finer details of SEO - I know what canonical tags are, but I am confused by how SEOmoz identifies the issue in campaigns. I run a site on a wordpress foundation, and I have turned on the option for "canonical URLs" in the All in one SEO plugin. I did this because in all cases, our content is original and not duplicated from elsewhere. SEOmoz has identified every one of my pages with this issue, but the explanation of the status simply states that canonical tags "indicate to search engines which URL should be seen as the original." So, it seems to me that if I turn this OFF on my site, I turn off the notice from SEOmoz, but do not have canonical tags on my site. Which way should I be doing this? THANK YOU.
Technical SEO | | mrbradleyferguson0 -
What does it mean by 'blocked by Meta Robot'? How do I fix this?
When i get my crawl diagnostics, I am getting a blocked by Meta Robot, which means that my page is not being indexed in the search engines... obviously this is a major issue for organic traffic!!! What does it actually mean, and how can i fix it?
Technical SEO | | rolls1230 -
Why is it that in the exported CSV there are no refrerring pages shown for 404 errors?
Within some of my campaigns i can see issues regarding 404 pages. Then when i export the data to a csv, sometimes the referring pages that lead tot the 404 are not shown. Am i missing something here?
Technical SEO | | 5MMedia0