Why is blocking the SEOmoz crawler considered a red "error?"
-
-
I think because that section is labeled "crawl errors", an area blocked from crawling would be considered an error. I can see where you're coming from, but think of it as an error found with an attempt to crawl, not necessarily an error found in the site itself.
-
So,
about 4xx errors read this article: http://webdesign.about.com/cs/http/p/http4xx.htm
for Seomoz crawler blocked by robots.txt , on this file, you have added two links, and are blocking the search engine robots to crawl/index this pages on their database.
about this error issue read here please: http://www.google.com/support/webmasters/bin/answer.py?answer=156449
hope helps,
thanks
-
It seems to me that it should be a "Notice" not an "Error." I am intentionally blocking bots from a defunct directory. Keeping SEOmoz out of an old directory should not (does not?) affect SEO, you know?
-
Sorry about that. I uploaded it 3 times and finally noticed the "Update" button after uploading on the 3rd attempt.
-
Hi, i can´t see the attached image, upload it on any imageshack or something like that and share here the url, and i will try to help you.
If the semozbot find errors on crawling,this mean your site have failures on programming of your site, it fails the " search engine friendly " optimisation.
send me image, i will try to help you.
-
wheres the attached image? its only an error b/c then they cant crawl and build data but thats just a guess
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Do we need rel="prev" and rel="next" if we have a rel="canonical" for the first page of a series
Despite having a canonical on page 1 of a series of paginated pages for different topics, Google is indexing several, sometimes many pages in each topic. This is showing up as duplicate page title issues in Moz and Screaming Frog. Ideally Google would only index the first page in the series. Do we need to use rel="prev" etc rather than a canonical on page 1? How can we make sure Google crawls but doesn't index the rest of the series?
Moz Pro | | hjsand1 -
Moz Crawl Test error
Moz crawl test show blank report for my website test - guitarcontrol.com. Why??? Please suggest.
Moz Pro | | zoe.wilson170 -
Blocked by Meta Robots.
Hi, I get this warning on my reporting. Blocked by Meta Robots - This page is being kept out of the search engine indexes by meta-robots. what does that means ? and how to solve that, if i using wordpress as my website engine. and about rel=canonical , in which page I should put this tag, in original page, or in copy page ? thanks for all of your answer, it will be means a lot
Moz Pro | | theconversion0 -
Does SEOmoz have a tool to find mirror sites?
I heard from a company that is trying to get my clients SEO business that they discovered multiple sites mirroring our site's content. Does SEOmoz have a tool to find these websites? Or does Google?
Moz Pro | | thomas.wittine0 -
SEOMoz On-Page Report Card
This question is for one of the SEOMoz staff. With the ongoing changes and improvement in algorithms, does the SEOMoz team keep the "On-page Report Card" up to date with best practices?
Moz Pro | | tdawson090 -
SEOMOZ can we trust you?
I was thinking today what are the chances that SEOMOZ can look into my campaigns and see what keywords I am targeting, strategies etc. and then sell that information to others? There has to be some type of clause when you sign up correct? But who knows because I'm not sure. Having Rand and Matt Curts talking via twitter to each other kind of concerns me. Not that I'm worried that Google will know my strategies because we don't do any black-hat linking and anything shady but how much power does SEOMOZ really have and can they leak any information to other companies or Google? Scary stuff that's why I don't put all my eggs into one basket, I spread them out. Thoughts? Thanks in advance - Brett Shaffer
Moz Pro | | EmpireSEO1 -
Is there a way to see all SEOMoz questions, comments, posts, responses that I've given a "thumbs up" to?
Lots of times I'll Thumbs Up a question, blog post or response not only if I think it's high quality but if I think I'd like to revisit it in the future. Essentially, I want to use a the SEO Moz Thumbs Up as a bookmark. Is there any way to see all the SEO Moz content that I have given a "Thumbs Up" to? I know I can review all the questions I've asked or answered in the "My Q&A" page. Perhaps, I'm just missing a "Thumbs Up" page somewhere on my profile?
Moz Pro | | TaitLarson2 -
SEOmoz Toolbar vs. Opensiteexplorer
Dumb question, why is the SEOmoz Toolbar reporting vastly different data than opensitexplorer? I had assumed they pulled from the same data set. False assumption? Am I misinterpreting the metrics? The discrepancies with which I am most confused are differences in number of root linking domains between OSE and Toolbar. Please enlighten me.
Moz Pro | | Gyi0