Haven't received an update on site crawl issues more than a week
-
Hello, my account has be scheduled to have the next updated report on 1st March. However, up till now, the latest data I have for our site crawl issues is made on 21st Feb. May I know if there is any issue related to this? Any way that i can draw the data for this week?
-
Thank you so much for your help.
I think the past few site crawl reports were quite on time, normally just a day later than the scheduled day. You mentioned our site appears to be large in size, may I know if our site size has been increased recently or the same as the previous time ?
-
Hi there,
Sam from Moz's Help Team here!
It appears that your site is quite large, and every week we typically crawl over fifteen thousand pages. Any site bigger than about 15k pages is going to take additional processing time. I'm looking at your historical crawls and it appears they each took around 3-4 days, rather than the usual 1 day for smaller sites. Your most recent crawl is still running, so you should expect to see your crawl information arrive within the next day or two, but I am afraid that I can't guarantee that, as the time to process the crawl data can fluctuate from week to week.
Unfortunately, we don’t have a way to force the crawler to re-crawl at a specific time right now - I'm sorry about that - if you’d like to do a mini crawl in the meantime to check up on your progress, you can run a Crawl Test! This'll allow you to crawl up to 3,000 pages of your site and evaluate the results in CSV form.
If you have any other questions, do feel free to ask away or pop a message over to help@moz.com!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is is possible to revert reporting to a past crawl date?
Site Crawl report defaults to the last crawl. Is there a way to get data from a previous crawl for comparison?
Product Support | | JThibode1 -
Crawl error robots.txt
Hello, when trying to access the site crawl to be able to analyze our page, the following error appears: **Moz was unable to crawl your site on Nov 15, 2017. **Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. Update these tags to allow your page and the rest of your site to be crawled. If this error is found on any page on your site, it prevents our crawler (and some search engines) from crawling the rest of your site. Typically errors like this should be investigated and fixed by the site webmaster. Can help us? Thanks!
Product Support | | Mandiram0 -
Crawl errors are still shown after fixed
Fixed long ago "title too long" and some 404 errors, but still keep on showing on error statistics
Product Support | | sws10 -
Reports Issues
Hello there, I recently re-activated my account and I have some issues with the reports. I have been notified by email that the crawl has been successful and data were collected but they refer to January and February instead of November. What should I do? Thanks
Product Support | | PremioOscar0 -
What day does Moz update the keyword rankings, my campaigns are all over a week since the last update?
HI, It has been over a week since the last ranking update and i'm wondering if these typically are run on a certain day? My last update was on 8/12/14.
Product Support | | SearchOpt0 -
My data is stuck and hasn't updated from a few weeks back
My campaign settings are for 500 pages to be crawled which I understand means it will be done once per week. However my data is stuck from a few weeks back and still hasn't been updated. Can you help?
Product Support | | Vivid-North0 -
Google Analytics Connection Issue with Moz Analytics
Hello Every time I go into a new page on Moz Analytics I get an error message asking me to reauthorise the Google analytics profile:- Our connection to your Google Analytics account was lost. Don't worry, you won't lose any data. Please reauthorize now. This doesn't happen in the old version. Is this a known issue?
Product Support | | peeveezee0 -
Missing campaign after billing update
My campaign is missing after I updated my billing info. Why would that be?
Product Support | | jaspmiller0