My site crawl has been in progress since last week
-
Hi there, I've been waiting on my site crawl to complete since Friday (it's Tuesday now), but it still has the 'in progress' notification at the top. Is it normal for it to take over 3 days? Or is there something holding it up?
-
Hey there! Tawny from Moz's Help Team here!
Site Crawl results can take up to a week or more to fully populate, depending on a lot of factors, like how large the site is, how many pages we're crawling, and what kinds of errors and Site Crawl issues our crawler is encountering along the way.
It looks like you've got a whole bunch of Campaigns set up, so I wasn't sure which to check on, but I would be willing to bet that it's the size of the crawl itself that's slowing things down.
Sorry I can't be much more help here — if you shoot us a note over at help@moz.com with the details of which Campaign you're talking about, we might be able to troubleshoot further.
Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawl test
I used to use the crawl test tool to crawl websites and it presented the information in a really useful hierarchy of pages. The new on-demand crawl test doesn't seem to do this. Is there another tool I should be using to get the data?
Product Support | | Karen_Dauncey0 -
Crawl error robots.txt
Hello, when trying to access the site crawl to be able to analyze our page, the following error appears: **Moz was unable to crawl your site on Nov 15, 2017. **Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. Update these tags to allow your page and the rest of your site to be crawled. If this error is found on any page on your site, it prevents our crawler (and some search engines) from crawling the rest of your site. Typically errors like this should be investigated and fixed by the site webmaster. Can help us? Thanks!
Product Support | | Mandiram0 -
Haven't received an update on site crawl issues more than a week
Hello, my account has be scheduled to have the next updated report on 1st March. However, up till now, the latest data I have for our site crawl issues is made on 21st Feb. May I know if there is any issue related to this? Any way that i can draw the data for this week?
Product Support | | Robylin10 -
Rogerbot not crawling our site
Has anyone else had issues with Roger crawling your site in the last few weeks? It shows only 2 pages crawled. I was able to crawl the site using Screaming Frog with no problem and we are not specifically blocking Roger via robots.txt or any other method. Has anyone encountered this issue? Any suggestions?
Product Support | | cckapow0 -
Why is Moz Crawl Diagnostics labelling pages as duplicate when they appear to be different?
Moz Crawl Diagnostics is flagging some pages on the Doorfit website as duplicate, yet the page content is completely different and not identical. Example. Page: http://www.doorfit.co.uk/locks-security/secondary-security Duplicate: http://www.doorfit.co.uk/seals-and-sealants?cat=279 Does anybody have any suggestions as to why this might be the case? Thanks
Product Support | | A_Q0 -
Received emails about new ranking, crawl and on page reports, but nothing new shows.
Yesterday morning I had emails about updated crawl, ranking and on page reports being available however nothing in my dashboard is newer than 2/21. I waited through yesterday to see if things changed, logged in and out etc but nothing new has shown up. Any ideas on why that is the case?
Product Support | | sea2dca0 -
Is it possible to split a moz account. We have 5 sites and one has been sold to another company. Can I split that site onto its own new account?
Is it possible to split a moz account. We have 5 sites and one has been sold to another company. Can I split that site onto its own new account?
Product Support | | BuyandSell0
