No (seomoz) crawler report since 7th may !!
-
Hi Mozteam,
I added a site less than 200 pages in the tool "seomoz crawler", at May 7.
We are May 15 and the tool always displays "crawl in progress."
Do you have a problem about this tool?
This is embarrassing ...
Thank you for your reply.
David
France
-
Hi Joel
if I tell you that I am doing SEO for 13 years you will not believe me :-))
tiredness or inattention ...thank you Joel and other contributors for your answers, I appreciate it.
David
-
Hey David,
Thanks for reaching out. I looked at your account and don't see any crawls that started on the 7th. I do see a crawl that started on the 3rd and hasn't completed because you are blocking all user agents in your robots.txt file.
You have this directive listed:
User-agent: *
Crawl-delay: 10
Disallow: /That is going to prevent all bots from accessing your site, not just RogerBot.
You'll want to either remove that or add a directive before that for User-agent: RogerBot allowing full access. Once that's done, just wait for the crawl to refresh and it should complete just fine.
Thanks!
Joel. -
Thank you,
no result at all... since may 7..
meanwhile I used Integrity .. but it is unfortunate that the report crawler does not work.
-
you have no results at all? as perfect007 said its updated once a week, so it normally says "in progress"
But if you still get no results by tomorrow, then report to the seomoz staff, along time ago I had a crawl problem where it was only crawling about 500 pages of my site, when we had 10,000+ pages. There was a technical problem with the crawl with my site which they fixed very quickly
-
Hi
thank you but it is precisely this tool I'm talking about ...
the crawl is "in progress" since May 7 ..
David
-
SEOMoz Tool crawls a website once a week, but you can do a separate crawl of any site (up to 3000 URLs) at http://pro.seomoz.org/tools/crawl-test. They generally update crawl Thursday to Thursday along with Ranking.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why does SEOMoz only crawl 1 page of my site?
My site is: www.thetravelingdutchman.com. It has quite a few pages, but for some reason SEOMoz only crawls one. Please advise. Thanks, Jasper
Moz Pro | | Japking0 -
Why does Seomoz report other values then Google Webmaster?
Dear Seomoz Community I check my Seomoz ranking from time to and today I saw a big discrepancy between the reported domains linking to my site in the Site Explorer and Google Webmaster tools. Seomoz reports 19 linking domains
Moz Pro | | menelik
Google shows 150 domains linking to my site. Is there an explanation for this discrepancy? Thank for helping me out 😉0 -
Drop in Number of Crawled pages by SEOMOZ?
I noticed that the number of Crawled Pages on my website has been 2 pages only over past week. Before that the number of crawled pages was over 1000. My site has numerous pages as it is a Travel website that pulls search results for Flights, Cars, Hotels, Cruises and Vacation packages so there is a huge Database there. Can someone help? Thanks !
Moz Pro | | sherohass0 -
On raking reports
Hello. I was wondering why doesn't SEOMoz update ranking reports daily as opposed to weekly. Rankings to change overnight and since other services do it (e.g sescout.com) I can't really why not this one.
Moz Pro | | phaistonian0 -
Google analytics sync with SEOMOZ
Hey guys, I'm looking to sync our clients google analytic profiles to our clients campaigns in SEO MOZ. However all our clients google analytic profiles are on the one google account and not separate accounts. So I'm asking does SEO MOZ only allow you to grab the traffic data of one clients profile from a google account instead of multiple profiles from the same google account for different campaigns? If so has anybody got a workaround or any suggestions? If I haven't explained myself clearly let me know and I'll break it down further. Thanks again. Rob
Moz Pro | | daracreative0 -
Help with SEOmoz API
Hi guys, I'm trying to make API requests from my webserver via PHP. I'd like to retrieve data from the SEOmoz URL Metrics API. Unfortunately I always get the error response "unauthorized" even when I copy and paste the Sample Valid API Signature generated by your system into the browser. Is Signed Authentication not longer supported? I even tried the sample PHP Code SignedAuth.php but there's the same problem, too. If signed authentication is not longer available, do you have a code example for the basic http authorization? Thanks, Brandon
Moz Pro | | thegreatpursuit1 -
Discrepancies in PA and LRDs reported in different SEOmoz tools
I've noticed a difference in the reported PA and LRD numbers for URLs depending on whether you use Open Site Explorer, or look at the same metrics from within the rankings history (in your campaign set up). I've checked this for a few URLs and what I'm seeing is the reported scores for PA and LRDs is different 9 times out of ten. The PA is sometiomes higher on one report, lower on another, or vice versa. Same for LRDs. I thought it might be because one report was lagging behind and using old data, but that would only make sense if I was seeing an increase in reported LRDs, but it just as often shows a decrease ! Is this just a bug in the campaign>rankings history report or is there a reason for the discrepancies?
Moz Pro | | Websensejim0 -
SEOMOZ tools are not helping!
So, I have a website www.mobikwik.com which provides mobile phone topup in India. I signed up for SEOMOZ Pro membership a little less than a month ago. For all our competitors , which rank above us in google as of today , I checked out two things a) competitive link analysis and b) on-page optimization. On b) , our home page had the best optimization for targeted keywords and the best score amongst all competitors who ranked above us. On a) , linkscape tools showed our moztrust and mozrank to be the best. Except for 2 competitors, our domain authority was also better than the rest. Inspite of all this, our website is ranked no more than 6 on google for all targeted keywords. We have the best quality links amongst our competitors. I am at a loss to understand this and how to improve our ranking. I have to make a decision whether to renew my SEOMOZ membership in 2 days time. Please help me decide!
Moz Pro | | mobikwik0