Why is on-demand crawl reporting numbers that are very different than the regualr site crawl by Moz?
-
When I look at the site crawl available through my dashboard, it reports 22.9K pages crawled. I just ran a on-demand crawl and it is only reporting 6K pages crawled. Why is the number so much lower?
-
Thanks! Can you tell me how long it generally takes for the Site Crawl to run? Mine has been reporting it is "In progress" for the past 8hrs??
-
Hey Charles!
The scope of the two tools are different, Site Crawl has a much higher limit of pages that can be crawled, with you plan we look for up to 20k 200ok pages, where On Demand Crawl is looking for only the first 3k pages that return 200 ok status.
Hope that helps, let me know if you need anything else.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz bot has trouble crawling Angular JS - I believe it's seeing the SPA (Single Page Application) before Universal. Anyone else have this issue? What is the fix?
The Moz bot user agent detection settings are able to read Universal, but the Single Page Application (SPA) version partially loads on the website before Universal. Because of this, Moz (and possibly search engines) think we have massive duplicate content issues. For example, the crawl report said a particular product page (which has about 1,000 words) has 33,000 words and has duplicate content with over 300 other pages. This makes me believe it's only picking up the SPA version. Has anyone come across this, and what would be the fix?
Moz Bar | | laurengdicenso1 -
Moz DA is not increasing
Hey my website best offset smokers under $1000 is not increasing DA. is there anyway to increase the DA currently its DA is 8
Moz Bar | | 0hjgh60 -
Moz Rankings vs DuckDuckGo
Hello, So we have a client that’s only interested in a handful of keywords. We would like track his rankings through a Moz Campaign but he currently uses Duck Duck Go to check them. Strictly from an accuracy perspective (and not necessarily added features like Mobile Rankings) is there any arguments we could use to convert them to Moz? If not we will let them know but any input would be appreciated. Looking forward to hearing from all of you! Thank you in advance for the help. Best,
Moz Bar | | Ben-R0 -
Moz is finding phantom pages
I suddenly have 4xx errors in my crawl diagnostics because pages with “/%3C/div” added to the end of the URL that are linked from the normal page can't be found. I didn't create the pages, and they don't exist, but Moz thinks that they do. I went back through to see if any changes in WordPress, theme or plugins versions might be the cause, but this is the only site that I have this issue, so I don't think that is it. Does anyone have an idea what causes this?
Moz Bar | | samuelldrew0 -
Has using Moz got me banned from Google search?
Dear fellow Mozzers, For the last couple of weeks when ever I do a google search I have to enter a captcha code. Now I hardly use google anymore which is annoying ! Then I went onto support.google.com and saw this: https://support.google.com/websearch/answer/86640?hl=en&ref_topic=3378866 "Automated traffic includes: Sending searches from a robot, computer program, automated service, or search scraper Using software that sends searches to Google to see how a website or webpage ranks on Google" Is Moz alone doing this? Thanks in advance for your response. Ash
Moz Bar | | -Ash-0 -
Can you give some examples of MOZ Local Partners who have an API and update quickly?
In answering questions about the speed of MOZ Local, I've seen this a few times: "The time it takes our partners to update the listing really depends on whether or not they have an API. If they do have an API, the listing will be updated pretty much immediately." Can someone provide a list of which Partners have an API, and which do not?
Moz Bar | | irapasternack0 -
How can the Moz Page Grader support a 'keyword portfolio' approach?
I used to use the Page Grader tools to support the old philosophy of one page - one keyword. With more focus now being given to a portfolio of keywords around a topic area - what would be a good approach to using the page grader tool? Obviously getting A's and B's is impossible for multiple keywords. The only way i've seen suggested in moz tools to help with keyword portfolios is to use labels in the ranking measurement and then find averages of the results. Are there other strategies that I can try?
Moz Bar | | AISFM0 -
Canonicals in crawling reports
The crawling reports gives info about several meta data missing, what about the lack of a canonical tag? This would be nice too... and images without alt tag (or empty).
Moz Bar | | KBC0