Why is on-demand crawl reporting numbers that are very different than the regualr site crawl by Moz?
-
When I look at the site crawl available through my dashboard, it reports 22.9K pages crawled. I just ran a on-demand crawl and it is only reporting 6K pages crawled. Why is the number so much lower?
-
Thanks! Can you tell me how long it generally takes for the Site Crawl to run? Mine has been reporting it is "In progress" for the past 8hrs??
-
Hey Charles!
The scope of the two tools are different, Site Crawl has a much higher limit of pages that can be crawled, with you plan we look for up to 20k 200ok pages, where On Demand Crawl is looking for only the first 3k pages that return 200 ok status.
Hope that helps, let me know if you need anything else.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate Content & Title Tag Group Fields on MoZ Report
Hello, On my SEO MOZ exported Site Crawl CSV report, I have columns for Duplicate Content Group & for Duplicate Title Tag Group. The values in the columns are numerical - 20, 5 , 15, etc. Can anyone explain to me what these values represent and how I can fix the issues I presume they represent? Thank you,
Moz Bar | | AED-1
Scott0 -
The factors considered in the new domain authority algorithm? On-site factors we can use to compare with competitors? Is having an NA as a spam score a bad thing?
Does anyone know the factors considered in the new domain authority algorithm other than spam score and complex distributions of links based on quality and traffic? Does anyone know of on-site factors we can use to compare with competitors to try and improve DA? Is having an NA as a spam score a bad thing?
Moz Bar | | CQMarketing0 -
Reworked the keyword strategy - affect on reports
Hello, We're ditching our current keyword strategy and starting over. The reports have been running for about 3 months though. Will our ranking reports factor in those keywords that have been removed? We really only want to see where are campaign is from the new starting point. Or, do I just need to narrow the time frame on my reports. Any advice is appreciated! Thanks!
Moz Bar | | craig_mozbot0 -
Does Moz's keyword tool pull data from your IP address?
Does anyone know how Moz's keyword tool pulls their keyword ranks? Do they take it based off of the IP (history and cookies) that is being used? I am trying to find a way to collect keyword data that is neutral and not based off of my previous searches, etc. TIA
Moz Bar | | ReviveMedia0 -
Create a report with keyword, label, difficulty, global search volume, and ranking?
Is it possible to create a report with containing keyword, label, difficulty, global search volume, and ranking? Currently in order to get the data, it seems like I need to manage two lists, the keyword list we are tracking and the keyword list in the Difficulty tool then somehow manually combine the data. Is there an easier way?
Moz Bar | | promfgsystems2 -
Does anyone else have issues with Moz's keyword search volume tool for Google's search engine?
It will show the search volume for Bing even when Google is selected. Then, if you select Bing, you'll get the same data as it shows for when you selected "google". So basically, this tool does not work for Google's search engine. Or it is most likely not a reliable way to perform keyword research. Anyone else notice this? Does Moz even offer a way to submit a support ticket to get this fixed?
Moz Bar | | ShokIdeaGroup1 -
Moz On-page is not working
My on-page is not working....I do have 3 keywords in the 1º position of Google.pt and the Moz is not reporting nothing....bug?
Moz Bar | | Popbox0 -
Moz reporting reliable?
I have been working with our MIS department on addressing our errors on duplicate content and titles caused by parameter URLs. MIS insists that they have solved the problem with canonical tags, which are in place. They said they were getting warnings from Google and Bing, but that after they put the canonical tags in place, those went away. They are questioning the Moz reports, suggesting that I instead rely on SEO Toolit by Microsoft. (As an aside, we are using SharePoint 2010, crossing our fingers for an upgrade to 2013, which presumably will make a lot of the issues we’re having go away). So my questions are: 1) Why are these Moz reports reporting all of these errors that have supposedly been rectified (in 2011)? Do I disregard the duplicate content/title errors on the Moz report and defer to SEO Toolkit, as MIS suggests?
Moz Bar | | SSFCU0