No (seomoz) crawler report since 7th may !!
-
Hi Mozteam,
I added a site less than 200 pages in the tool "seomoz crawler", at May 7.
We are May 15 and the tool always displays "crawl in progress."
Do you have a problem about this tool?
This is embarrassing ...
Thank you for your reply.
David
France
-
Hi Joel
if I tell you that I am doing SEO for 13 years you will not believe me :-))
tiredness or inattention ...thank you Joel and other contributors for your answers, I appreciate it.
David
-
Hey David,
Thanks for reaching out. I looked at your account and don't see any crawls that started on the 7th. I do see a crawl that started on the 3rd and hasn't completed because you are blocking all user agents in your robots.txt file.
You have this directive listed:
User-agent: *
Crawl-delay: 10
Disallow: /That is going to prevent all bots from accessing your site, not just RogerBot.
You'll want to either remove that or add a directive before that for User-agent: RogerBot allowing full access. Once that's done, just wait for the crawl to refresh and it should complete just fine.
Thanks!
Joel. -
Thank you,
no result at all... since may 7..
meanwhile I used Integrity .. but it is unfortunate that the report crawler does not work.
-
you have no results at all? as perfect007 said its updated once a week, so it normally says "in progress"
But if you still get no results by tomorrow, then report to the seomoz staff, along time ago I had a crawl problem where it was only crawling about 500 pages of my site, when we had 10,000+ pages. There was a technical problem with the crawl with my site which they fixed very quickly
-
Hi
thank you but it is precisely this tool I'm talking about ...
the crawl is "in progress" since May 7 ..
David
-
SEOMoz Tool crawls a website once a week, but you can do a separate crawl of any site (up to 3000 URLs) at http://pro.seomoz.org/tools/crawl-test. They generally update crawl Thursday to Thursday along with Ranking.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Analytics reporting
I am new to the world of SEO and Google Analytics specifically. I want to find a way to easily see top pages, search terms, and traffic. In Moz I thought I could see this by using "traffic from search", but I only see one page that is ghost spam nothing related to any of my pages. I made sure the right account is connected and it is. Any suggestions on how to get this data easily?
Moz Pro | | CRMI0 -
Getting my top keywords separated out in SEOmoz reports
I am using the standard functionality to produce weekly Moz reports. There does not seem to be a setting to show rankings of my most important keywords. It would be nice to have those high-level keywords on the first page. For example, I have 200 keywords in an account. I want the report to show on a page my 10 most important keywords. Is there a way to set up a Label to my keywords in order to product a report page just for those keywords?
Moz Pro | | clicktoshop0 -
One page report are empty !
Hi Rodgerbot, Now, i've no seomoz one page report for any campaign 😞 What happen ? I've previously several report. Thanks,
Moz Pro | | Max840 -
Why have I stopped receiving emails about crawl reports and rankings reports?
I used to receive emails weekly telling me a new crawl had completed and the reports were ready and also another email saying the new rankings and on page reports were ready to view - I am not getting these anymore. Does this mean these are still happening but I need to find them within the package or has something changed? Thanks
Moz Pro | | Fitsensesports0 -
SEOmoz Keyword Ranking - Does it work for local search?
I was just wondering how SEOmoz calculates keyword rankings up and down every week. Shouldn't there be a way to have SEOmoz calculate rankings on a Local and Non-Local Basis? For example I have "Local Dentist" as a keyword in SEOmo for my dental client. SEOmoz shows that we are not in the Top 50. | Local dentist Keyword History Ranking Analysis | Not in Top 50 | Moved unknown 0 spaces | Not in Top 50 | Moved unknown 0 spaces | Not in Top 5 | If I change my location in Google browser to the zip of where the office is located, we
Moz Pro | | Czubmeister
show up in position 14(for the home page) & 15 (for an inside page) How can I show the keyword rankings to my client if the keyword ranking report doesn't reflect searches done in my clients local area?0 -
Why does SEOMoz crawler ignore robots.txt?
The SEOMoz crawler ignores robots.txt It also "indexes" pages marked as noindex. That means it is filling up the reports with things that don't matter. Is there any way to stop it doing that?
Moz Pro | | loopyal0 -
Recommend SEOmoz PRO Tools on LinkedIn
Hey Moz Community, Because honest user reviews are the best way to inform people about SEOmoz PRO tools and benefits, we'd love for those of you who are on LinkedIn to leave a recommendation for our product: http://mz.cm/urHa1e If you do choose to leave a review, please be honest in what you say. Even if it's not 100% hearts & flowers, we'd rather you keep it real. Thanks!
Moz Pro | | EricaMcGillivray0 -
On-Page Summary (Report Cards) automation?
Hi everyone, Under the "On-Page" tab which shows your report cards, is there a way of getting it to grade your entire site? One of my site's is only ~20 pages so it's no big deal to manually enter each URL and set each one to update weekly. But what if I have a site that has ~1,000 pages and I want to optimise each and every page for my main keyword using the report cards feature? Thanks in advance! 🙂 Ash
Moz Pro | | AshSEO20110