How long does it typically take MOZBOT to crawl a site?
-
Our site has had "crawl in progress" for over 24 hours now without an update, we're dying for the results since our last changes :).
-
24 hours isn't out of the ordinary. I've had a site with a blog that took close to 3 days to complete a full crawl. You could use the report card page if you're looking for an update regarding those changes for a specific page or two.
-
Depending upon the site, I have seen campaigns indexed in as little as 12hrs and as much as 48-72hrs. Again, that could also depend upon what's in the queue and what the resources available are and how big your website is.
You might also want to try the Crawl Test tool at http://pro.seomoz.org/tools/crawl-test
It usually completes pretty fast and the data is always good to have.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How do I retrieve crawl and ranking data about a site from the past?
Hey. One of my main clients has asked to see the crawl data and rankings data for the past eight months. He wants to have tangible evidence of the effects of Penguin. I would like that info too. Is it possible to retrieve that information on a weekly crawl and ranking basis through SEO Moz and if so, how do you do it? I simply want to show a graph, timeline and brief explanation across several main keywords... Help me as you guys always do - You rock Best Ben
Moz Pro | | creativeguy0 -
Looking for Advice on SEO for Minimilistic Site
Hi everyone, I found this site and it looks like a great place for us to start, we have just opened the doors to our new website fenwaymedia thats a dot co dot uk. Now Ihave tried to maintain the most minimilistic design throughout but I believe with this comes certain drawbacks - - - - S E O which is why i am here. My thought were that I would draw my clients from the Web Design, web Marketing & Blog page which I will starting in 3 hours be constantly updating. but Im not sure Im doing the right thing. I am trying to target Edinburgh, Scotland although we would take work from anywhere, if anyone could spare us a moment, I would greatly appreciate any help, tips or comments that might help us attain some visibility. Thanks in advance and thanks for looking. Kind regards, Craig
Moz Pro | | fenwaymedia0 -
How can I get a report of the top 500 national sites using Domain Authority and Page Authority? Does someone have to type sites in one by one on Site Explorer or is there another way?
I want to know what sites and blogs have the to rankings overall based on their Domain Authority and Page Authority - Top 500 - 1000 in nation - I want to know which ones are follow and no-follow too - Does anyone know? Has anyone run such a report yet? Thanks for help - BD
Moz Pro | | creativeguy0 -
How to Link build for our site
Hello, A client of mine has a site that gives advice to people. It's moderately competitive. It's a content site. Using Open Site explorer, I looked up competitor's top pages and backlinks, and there were things such as sites that were heavy on directories, sites heavily on editorial mension, sites on juicy topics that I don't want to cover, and the rest was pretty much junk. Just so that you know, I only link build with quality websites that look strong, long term, have a nice design, are high quality, and are not a directory (with a few exceptions) What's the standard way to link build with a site like this? We've got 7 articles of good content that is from me spending hours learning about the subject and using my skills as a life coach. Right now I'm just adding quality content and social media. I am not a top expert in the field, but I'm learning as much as possible. How do we link build?
Moz Pro | | BobGW0 -
Open Site Explorer Update
What is taking OSE so long to update? The update schedule said the next update was going to be on Dec 28th.
Moz Pro | | Robbie8299
If you open OSE it says "Last Index Update: November 28th, 2011" Today in January 1st. Any thoughts as to why the delay?0 -
Link Diagnosis and Open Site Explorer
I work at a web design firm that's starting to offer SEO to its clients. They want to keep costs down until the SEO side becomes more established, so I've been using mostly free tools to do the SEO. I've been using a website called LinkDiagnosis.com to check backlinks for clients. It says the data is provided by SEOmoz, so I thought it must be pretty reliable. However, I just signed up for the PRO trial to test out all of SEOmoz's tools (& hopefully convince my company to sign us up), and I find that the link information between the 2 tools can be vastly different! Sometimes the number of unique linking domains is very close, but other times it can be off by hundreds, even thousands, with Open Site Explorer typically providing the higher numbers. Is the Link Diagnosis tool really powered with data from SEOmoz, or does it just receive a portion of the data, since it's a free tool? I'm just trying to figure out what will be the most reliable solution for me to keep using, and the discrepancies between the two tools has caused me to question the reliability of both. Thanks, Hector
Moz Pro | | hmunoz0 -
Changing the Timeframe of Historical Crawl Data
Hello, Just read a great post about the implications of duplicate content for sites after the most recent Panda update: http://www.seomoz.org/blog/duplicate-content-in-a-post-panda-world?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+seomoz+(SEOmoz+Daily+Blog) In the post is an image or crawl data history that shows months, not days or weeks, worth of trending data as it relates to duplicate content. So my question is this: How do I change my view/date range on my own campaigns so that I can view the trailing months of data rather than only what seems to be the past 4 weeks or so? This would really help me identify the impact of some on page changes we've recently made for a client. Many Thanks, Jared
Moz Pro | | surjm0 -
Is The Crawl Diagnostic tool working correctly?
The Crawl Diagnostic tool shows issues and displays a graph but they don't display the page specific results/suggestion like it used to. I get the "Congratulations, there are no pages affected by this issue!" message.
Moz Pro | | -PAUL-0