No (seomoz) crawler report since 7th may !!
-
Hi Mozteam,
I added a site less than 200 pages in the tool "seomoz crawler", at May 7.
We are May 15 and the tool always displays "crawl in progress."
Do you have a problem about this tool?
This is embarrassing ...
Thank you for your reply.
David
France
-
Hi Joel
if I tell you that I am doing SEO for 13 years you will not believe me :-))
tiredness or inattention ...thank you Joel and other contributors for your answers, I appreciate it.
David
-
Hey David,
Thanks for reaching out. I looked at your account and don't see any crawls that started on the 7th. I do see a crawl that started on the 3rd and hasn't completed because you are blocking all user agents in your robots.txt file.
You have this directive listed:
User-agent: *
Crawl-delay: 10
Disallow: /That is going to prevent all bots from accessing your site, not just RogerBot.
You'll want to either remove that or add a directive before that for User-agent: RogerBot allowing full access. Once that's done, just wait for the crawl to refresh and it should complete just fine.
Thanks!
Joel. -
Thank you,
no result at all... since may 7..
meanwhile I used Integrity .. but it is unfortunate that the report crawler does not work.
-
you have no results at all? as perfect007 said its updated once a week, so it normally says "in progress"
But if you still get no results by tomorrow, then report to the seomoz staff, along time ago I had a crawl problem where it was only crawling about 500 pages of my site, when we had 10,000+ pages. There was a technical problem with the crawl with my site which they fixed very quickly
-
Hi
thank you but it is precisely this tool I'm talking about ...
the crawl is "in progress" since May 7 ..
David
-
SEOMoz Tool crawls a website once a week, but you can do a separate crawl of any site (up to 3000 URLs) at http://pro.seomoz.org/tools/crawl-test. They generally update crawl Thursday to Thursday along with Ranking.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why Do Different Tools Report 404s Differently?
Hi Mozers, How come Moz reports just six 404 errors, whereas Google Search Console reports 250 and Screaming Frog only reports a dozen? It seems to me that these results are all over the place. Shouldn't these reports be more consistent? I do understand that Search Console includes historical data and that URLs or issues need to be "marked as fixed" in order for them to go away, however, even if I do this, Google ends up reporting far more errors than anything else. Do 404s reported by Moz and Screaming Frog NOT include external links? It seems to me that this could be partially responsible for the issue. Also, is there a way to efficiently track the source of the 404s besides clicking on "Linked From" within Search Console 250 times? I was looking for something like this is Moz or SF but no luck. Any help is appreciated. Thanksabunch!
Moz Pro | | EricFish0 -
SeoMoz keyword page grader report card
Hi Ive recently 301 redirected old pages/urls to new pages/urls due to a site redesign. The seomoz kw report card is still reporting the old urls though with a significantly reduced score for most pages (i.e. from A's to now C's, from B to now D's etc). Does this mean mozbot is following the 301's & its actually the new urls being graded as such or is it referring to the old pages ? I will be adding the new urls to report card shortly but just interested in clarifying the above since i would have thought, if it is the old pages, they would not be reporting any score for those, or its scoring the new pages ? Many Thanks Dan
Moz Pro | | Dan-Lawrence0 -
Is it possible to submit a page to the seomoz index?
We recently got added to dmoz and botw and would like to see those links considered in our domain authority as we are tracking our progress and comparing ourselves to other sites. Is it possible to submit links to the seomoz index manually to have those tracked? (If I am even understanding this correctly)
Moz Pro | | hyperthalamus0 -
Why do the Ranking Report emails differ from the acutal Ranking Report?
I have been noticing that the Rankings listed in the emails are far different from the ones in my report once I log in. Any idea what this is about? Often the rankings in the email are much better then in the report. And I am talking about on the same day as the email was sent out, not a week later.
Moz Pro | | 2CDevGroup0 -
SEOmoz Campaign Setup: What would you do?
I've been using moz for nearly a year now. Initially when I set up our site (rac.com.au) it was as a single campaign for the rac.com.au domain. However, our business has a number of different product offerings and marketing teams (Insurance, finance, travel/tourism, automotive, security etc) - would I be better off setting each of these 'sub' brands as a campaign on their own using the 'folder' campaign setup? For example, have a campaign setup for the Insurance business (rac.com.au/insurance) folder, Finance business (rac.com.au/finance) and so forth? The advantage I see to the folder campaign setup is more specific reporting for each of the business units. Are there disadvantages to this? Any recommendations would be greatly appreciated. Cheers Ryan
Moz Pro | | Hutch_e0 -
Why does SEOMoz think I have duplicate content?
The SEOmoz crawl report shows me a large amount of duplicate content sites. Our site is built on a CMS that creates the link we want it to be but also automatically creates it's own longer version of the link (e.g. http://www.federalnational.com/About/tabid/82/Default.aspx and http://www.federalnational.com/about.aspx). We set the site up so that there are automatic redirects for our site. Google Webmaster does not see these pages as duplicate pages. Why does SEOmoz consider them duplicate content? Is there a way to weed this out so that the crawl report becomes more meaningful? Thanks!
Moz Pro | | jsillay0 -
Has the relevancy of SEOmoz tools disappeared?
I have A rankings for my on-site grades for my most important keywords. I have no Critical issues and no Warnings with my Crawl Diagnostics. Most of the Competiive Link analysis data shows my site beating out the competition. If all this is accurate, how can my SERPs continue to decrease and lesser pages with terrible optimization and backlinking be ranking higher? I even have a facebook page beating me in the results. If there is nothing left for me to address using SEOmoz, and I keep getting worse & results, doesn't it mean that the SEOmoz tools are not relevant to producing actual results? Or, am I missing something?
Moz Pro | | TOPYX0 -
Anyone having problems with the SEOmoz KWD Tool??
Just a quicky: Tried to run keyword difficulty tool reports last couple of days but keep getting error messages regardless of how many words/phrases I request. Is this a general outage or just me? Cheers
Moz Pro | | lovealbatross
James0