How do a run a MOZ crawl of my site before waiting for the scheduled weekly crawl?
-
Greetings:
I have just updated my site and would like to run a crawl immediately. How can I do so before waiting for the next MOZ crawl?
Thanks,
Alan -
-
Thanks Darin!!
I have requested the crawl. Hoping I get the report within a few hours.
Regards,
Alan Rosinsky -
Hey Alan,
Thanks for the question! You can use the crawl test if you are between scheduled crawls, but if you run test within a few days of a scheduled crawl you may end up with cached information. You shouldn't run the crawl test on a regular basis, but its fine to do every once and a while.
Cheers,
Ryan Watson
Business Development Associate | Moz -
I love the screaming frog tool that Matt recommended but we do have a crawl tester here on moz.com
http://pro.moz.com/tools/crawl-test
You can perform the crawl up to twice per day. It will tell you that you'll get results within 24 hours but I've never had it take more then 4 hours for a regular sized site.
Hope this helps.
Darin.
-
What kind of info are you looking for the crawl to provide? Moz will do a quick crawl and then a detailed crawl within a week. However, there are other things you can use.
EDIT: You can use the Moz tool - http://pro.moz.com/tools/crawl-testOne of the best on the market is Screaming Frog Spider. You can do so many things with it. There is a great post over at SEER Interactive on things to do with it:
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Spam Analysis vs. GWMT Links to Your Site
Hi Moz Community, I have been conducting some link auditing and started comparing the Moz Spam Analysis tool with the links provided in Google WMT. It appears that the Moz Spam Analysis tools shows an aggregate of links that Moz may or may not consider spam, however when you download and look at Google's "Links to Your Site" list it provides every link iteration known to man that's pointing to the target website - without providing any hints as to whether or not a link may be considered spam by Google. The biggest concern I have here is that Google is picking up a lot of links, which I consider spam, that do not appear in the Moz Spam Analysis results. I guess the question(s) I have are: Does it make sense to compare these two data sets? Has anyone else tried this comparison and how did you use the information to make positive changes? Any recommendations when it comes to determining if an external link is spam/hurting/helping a website? Thank you!
Moz Pro | | GoogleDowner0 -
Campaign Crawl
I have a site with 8036 pages in my sitemap index. But the MozBot only Crawled 2169 pages. It's been several months and each week it crawls roughly the same number of pages. Any idea why I'm not getting fully crawled?
Moz Pro | | JMFieldMarketing0 -
How can I cancel a running crawl test?
I put in two urls that were incorrect and now I need to cancel the report generation. Is there a way to do this? And if so, would I get my crawl-credits back? Are they cumulative?
Moz Pro | | krenerr0 -
How do YOU use site explorer?
I normally use open site explorer to identify links that competitors of my clients have and sometimes this gives me what I call 'some low hanging fruit' to go after. (and of course links that are more challenging to get) I don't know why this didn't occur to me sooner. If my client is a chiropractor why not look at the links for 50 or 100 of the top rankings chiropractic sites all over the US? This would HAVE to uncover a wealth of blogs to comment on that have good authority, great industry associations, publications, forums - a whole wealth of items. It made me wonder how many people use site explorer like I have been (top 3-4 competitors that your client has) or identifying links pointing to LOTS of competitors? How do you use it? Couldn't you almost base an entire link building campaign using OSE? Why would this be a bad idea if not? Just some random thoughts. THE WEEKEND IS ALMOST HERE - Have a great day everybody! 🙂
Moz Pro | | Mrupp441 -
Crawl Diagnostics
Hello, I would appreciate your help on the following issue. During Crawl procedure of e-maximos.com (WP installation) I get a lot of errors of the below mentioned categories: Title Missing or Empty & Missing Meta Description Tag for the URLs: http://e-maximos.com/?like_it=xxxx (i.e. xxxx=1033) Any idea of the reason and possible solution. Thank you in advance George
Moz Pro | | gpapatheodorou0 -
My Moz domain authority fell last week but so did all 3 of my competitors. What could cause that?
As a loyal Moz Pro subscriber I track my site's authority, trust and links against 3 similar competitors. Last week my authority fell from 61 to 60 but all 3 competitors saw a drop in their authority that week too. Was the Moz domain authority calculation changed? Did anyone else see a drop or has something odd happened to just our market? Any ideas? Not sure if this is something I should address or just shrug and ignore. Cheers
Moz Pro | | SteveBrumpton0 -
Crawl Diagnostics Report
I'm a bit concerned about the results I'm getting from the Crawl Diagnostics Report. I've updated the site with canonical urls to remove duplicate content and when I check the site - it all displays the right values, but the report, which has just finished crawling is still showing a lot of pages as duplicate content. Simple example: http://www.domain.com http://www.domain.com/ Both of them are in the duplicate content section although both have canonical url set as: Does each crawl check the entire site from the beginning or just the pages it didn't have a chance to crawl the last time? This is just one of 333 duplicate content pages, which have canonical url pointing to the right page. Can someone please explain?
Moz Pro | | coremediadesign0 -
Seo Moz for Clients
One thing I recently pondered following the introduction of logos on reports bringing that level of personalisation for the customers is ... would it be somehow possible to take it a step further and have a login on your own personal site that could somehow enable clients to download and look at the information as and when they wanted. An almost mini sep moz for clients where customers login through your own site ?
Moz Pro | | onlinemediadirect0
