No (seomoz) crawler report since 7th may !!
-
Hi Mozteam,
I added a site less than 200 pages in the tool "seomoz crawler", at May 7.
We are May 15 and the tool always displays "crawl in progress."
Do you have a problem about this tool?
This is embarrassing ...
Thank you for your reply.
David
France
-
Hi Joel
if I tell you that I am doing SEO for 13 years you will not believe me :-))
tiredness or inattention ...thank you Joel and other contributors for your answers, I appreciate it.
David
-
Hey David,
Thanks for reaching out. I looked at your account and don't see any crawls that started on the 7th. I do see a crawl that started on the 3rd and hasn't completed because you are blocking all user agents in your robots.txt file.
You have this directive listed:
User-agent: *
Crawl-delay: 10
Disallow: /That is going to prevent all bots from accessing your site, not just RogerBot.
You'll want to either remove that or add a directive before that for User-agent: RogerBot allowing full access. Once that's done, just wait for the crawl to refresh and it should complete just fine.
Thanks!
Joel. -
Thank you,
no result at all... since may 7..
meanwhile I used Integrity .. but it is unfortunate that the report crawler does not work.
-
you have no results at all? as perfect007 said its updated once a week, so it normally says "in progress"
But if you still get no results by tomorrow, then report to the seomoz staff, along time ago I had a crawl problem where it was only crawling about 500 pages of my site, when we had 10,000+ pages. There was a technical problem with the crawl with my site which they fixed very quickly
-
Hi
thank you but it is precisely this tool I'm talking about ...
the crawl is "in progress" since May 7 ..
David
-
SEOMoz Tool crawls a website once a week, but you can do a separate crawl of any site (up to 3000 URLs) at http://pro.seomoz.org/tools/crawl-test. They generally update crawl Thursday to Thursday along with Ranking.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Local search results reporting
Is there a way I can report on local search results for our keywords by city?
Moz Pro | | RPM5
For example could I specify Phoenix or Chicago and then see how we rank as if we did the search in that city?0 -
Are the SEOMoz queries banned by Google?
Hi: In our company, we have notified that Google is banning our IP due to massive queries under the same IP. It is caused mainly by local softwares installed in PCs or some plugins of Firefox. We think that SEOmoz don´t causes this due to its tool uses its own IP and servers, not ours. We would like your opinion about this. Thank you,
Moz Pro | | Equipo_SEO_HUB_Interaction0 -
How to use Crawl Report for a test directory
I have a client's new site set up in a folder that is not linked to from the main site. When setting up the Crawl Report, I put in the starting url for the new folder, http://oldsite.com/new/start.php. The Crawl Report came back with a crawl of the current site instead. How do folks run the crawl report to test sites before they are public? Thanks!
Moz Pro | | SWDDM0 -
Adjusting SEOmoz Crawling Speed
How do you adjust the SEOmoz crawling speed? SEOmoz tried to crawl 10,000 pages in 3 hours and crashed our MySQL server.
Moz Pro | | cappuccino891 -
Seomoz bar: No Follow and Robots.txt
Should the Mozbar pickup 'nofollow" links that are handled in robots.txt ? the robots.tx blocks categories, but is still show as a followed (green) link when using the mozbar. Thanks! Holly ETA: I'm assuming that- disallow: myblog.com/category/ - is comparable to the nofollow tag on catagory?
Moz Pro | | squareplug0 -
Getting SEOMoz reports to ignore certain parameters
I want the SEOMoz reports to ignore duplicate content caused by link-specific parameters being added to URLs (same page reachable from different pages, having marker parameters regarding source page added to the URLs). I can get Google and Bing webmaster tools to ignore parameters I specify. I need to get SEOMoz tools to do it also!
Moz Pro | | SEO-Enlighten0 -
SeoMoz are creawling all the time. it´s fine?
HI about 1 week, the SeoMoz told me that was crawiling all the time . i don´t know if it a problem whit the system or is new software implemented. i´ts says about 20 days crawiling thanks
Moz Pro | | monotero0 -
Campaign keywords (48) and on page report (17)
I go into my campaign keywords and have 48, but when I view my on page report only 17 show up? All keywords have been in there since last Friday except 2-26-11, 4 I added this Friday 3-4-11.
Moz Pro | | SmallFry340