No (seomoz) crawler report since 7th may !!
-
Hi Mozteam,
I added a site less than 200 pages in the tool "seomoz crawler", at May 7.
We are May 15 and the tool always displays "crawl in progress."
Do you have a problem about this tool?
This is embarrassing ...
Thank you for your reply.
David
France
-
Hi Joel
if I tell you that I am doing SEO for 13 years you will not believe me :-))
tiredness or inattention ...thank you Joel and other contributors for your answers, I appreciate it.
David
-
Hey David,
Thanks for reaching out. I looked at your account and don't see any crawls that started on the 7th. I do see a crawl that started on the 3rd and hasn't completed because you are blocking all user agents in your robots.txt file.
You have this directive listed:
User-agent: *
Crawl-delay: 10
Disallow: /That is going to prevent all bots from accessing your site, not just RogerBot.
You'll want to either remove that or add a directive before that for User-agent: RogerBot allowing full access. Once that's done, just wait for the crawl to refresh and it should complete just fine.
Thanks!
Joel. -
Thank you,
no result at all... since may 7..
meanwhile I used Integrity .. but it is unfortunate that the report crawler does not work.
-
you have no results at all? as perfect007 said its updated once a week, so it normally says "in progress"
But if you still get no results by tomorrow, then report to the seomoz staff, along time ago I had a crawl problem where it was only crawling about 500 pages of my site, when we had 10,000+ pages. There was a technical problem with the crawl with my site which they fixed very quickly
-
Hi
thank you but it is precisely this tool I'm talking about ...
the crawl is "in progress" since May 7 ..
David
-
SEOMoz Tool crawls a website once a week, but you can do a separate crawl of any site (up to 3000 URLs) at http://pro.seomoz.org/tools/crawl-test. They generally update crawl Thursday to Thursday along with Ranking.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Universal results not in pdf or csv reports
Right now, the universal results show up when I look at tankings on the site, but do not show up at all in the weekly pdf reports. They also did not appear in the full rankings history .csv report. They only appear in the weekly csv report, and then, the information is not as detailed as it is on the website (it only shows whether a universal exists, but doesn't indicate at what position it shows up). This limits the usefulness of these reports to my customers. I need to be able to show them rankings histories, including universal results, in their monthly or weekly reports. Including the charts would be nice as well. Since I can individually download the .pdfs for these for each keywords, why can't we just include it in the monthly reports. Also, would like to be able to view rankings history for all three search engines at once for a keyword, or multiple keywords to reduce the number of pages in a report. Can you add this feature?
Moz Pro | | HMS0 -
SEOmoz Campaign Setup: What would you do?
I've been using moz for nearly a year now. Initially when I set up our site (rac.com.au) it was as a single campaign for the rac.com.au domain. However, our business has a number of different product offerings and marketing teams (Insurance, finance, travel/tourism, automotive, security etc) - would I be better off setting each of these 'sub' brands as a campaign on their own using the 'folder' campaign setup? For example, have a campaign setup for the Insurance business (rac.com.au/insurance) folder, Finance business (rac.com.au/finance) and so forth? The advantage I see to the folder campaign setup is more specific reporting for each of the business units. Are there disadvantages to this? Any recommendations would be greatly appreciated. Cheers Ryan
Moz Pro | | Hutch_e0 -
How to increase ranking on google by using pro seomoz
Hi Team, I am trying to get good rank on this 2 keywords, gift card http://www.giftbig.com/gift-cards.html and gift vouchers http://www.giftbig.com/gift-vouchers.html, can anyonw suggest me how to rank on these 2 keywords. Now I m using SEO moz pro to get the solution.
Moz Pro | | Joydeep_das0 -
Report not showing all links
I am trying to pull the back link report for the following URL www.hotscripts.com/category/scripts/php/scripts-programs/image-galleries/ OSE shows a total of 589 back links. When i download the report all I get in excel is 207. Why?
Moz Pro | | inetteam1 -
Why is the SEOmoz customer service on this site so awful?
Half the time the tools don't work and there isn't any accountability. Has anyone else had the same experience?
Moz Pro | | wpsoule1 -
Drop in number of Pages crawled by Moz crawler
What would cause a sudden drop in the number of pages crawled/accessed by the Moz crawler? The site has about 600 pages of content. We have multiple campaigns set up in our Pro account to track different keyword campaigns- but all for the same domain. Some show 600+ pages accessed, while others only access 7 pages for the same domain. What could be causing these issues?
Moz Pro | | AllaO0 -
Rankings Report Visits Number timing?
I linked up the reports to my analytics account, and wanted to double check the period it uses for that number. When showing visits what time period is the report showing me? If I double check my stats in GA it looks like the past week but wanted to double check. Thanks!
Moz Pro | | SL_SEM0 -
Trifecta Report (domain)
Recently i have found that the data in the trifecta report is becoming less complete. For the last few sites i found that the report returned about half of the metrics it was looking for. For instance, it mentioned that one of the domains did not have a dmoz or wikipedia link/page even though they had both? Also, it rarely returns the Yahoo Site Explorer metrics even though when clicking to see the source the data is there? Are you guys planning on phasing out this tool, if not it seems like some work needs to be done on cleaning it up. Thanks!
Moz Pro | | kchandler1