Moz crawling
-
Hi Everyone!
I'm new to the SEOMoz and wanted to find out if there is a way to decrease the waiting time for the campaign crawl. I have made a lot of changes based on the first crawl and would like to see how these are reflected on the reports, but can't until the next crawl is performed.
Any help would be greatly appreciated.
-
Thanks Keri - much appreciated.
-
The crawl test is separate from the campaigns (as you can run it on any subdomain as you wish). The crawls are two subdomains in 24 hours. Hope this helps!
Keri
-
Also - forgotten to ask - the report generated by the Crawl Test - is it going to be displayed with the relevant campaign or is it separate from the campaigns?
-
Hi Keri,
Thanks for the prompt reply.
How does it work with those credits - I can see on that page that there were (as I've just used one) 2 Crawl credits. Are these credits reset every day so that I can perform 2 crawls a day?
-
You might try a custom crawl, which will crawl up to 3000 pages and should take a few hours, up to 24 hours. It's available at http://pro.seomoz.org/tools/crawl-test.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Why doesn't moz notify me of missing image alt tags
We had a client come to us and let us know another vendor had notified them that many of the images on their site are missing alt tags / text. I know this was a big deal back in the day, but I haven't heard much about it lately. I am assuming if it doesn't even show up in the Moz site crawl, it must not be a big deal any more, but I would love to have more info about how important image alt tags are and if they are important, why Moz does not report them.
Moz Pro | | CaliberMG1 -
Moz vs google data conflict?
Hi there, I am doing an SEO site audit for a client(giveaway, and here is the problem: when performing site:domain.com on google --> 13,800 pages were found When I see this number it seems to be a bit too much compare to the links i checked on integrity(link check for broken links) which gave me a result of 1291. I digged in more into the Google results and saw hundreds(maybe thousands) of pages that are blocked by robots.txt. So I am thinking, ok this is it, thousands of pages can't be crawled by the search engines. Here is the big BUT though, then I check at my moz crawl (see attachment) and no pages are blocked by the SEs, and then look at the dups, only 23 recorded?? Is Moz not crawling properly the 13,800 results that google finds or is this some magical phenomenon happening here? I am really confused here that is why I need some help here! Thank you guys! A990Hu4.png k842AOn.png
Moz Pro | | Ideas-Money-Art0 -
Moz campaign works around my robots.txt settings
My robots.txt file looks like this: User-agent: * Disallow: /*? Disallow: /search So, it should block (deindex) all dynamic URLs. If I check this url in Google: site:http://www.webdesign.org/search/page-1.html?author=47 Google tells me: A description for this result is not available because of this site's robots.txt – learn more. So far so good. Now, I ran a Moz SEO campaign and I got a bunch of duplicate page content errors. One of the links is this one: http://www.webdesign.org/search/page-1.html?author=47 (the same I tested in Google and it told me that the page is blocked by robots.txt which I want) So, it makes me think that Moz campaigns check files regardless of what robots.txt say? It’s my understanding User-agent: * should forbid Rogerbot from crawling as well. Am I missing something?
Moz Pro | | VinceWicks0 -
Sub-accounts on Moz
Can you create sub-user accounts on Moz?... Ones which provide limited access to certain users like use of the tools or access to view rankings in a campaign without being able to edit anything??
Moz Pro | | Qology1 -
How often does seomoz crawl the site? Can you force a crawl at a specific time ?
How often does seomoz crawl the site? Can you force a crawl at a specific time ?
Moz Pro | | stewbuch18720 -
SEOMoz Crawling Only 1 Page
I entered a new site into my dashboard 2 days ago - everything looked kosher, there were a few hundred pages crawled and a whole bunch of errors. I came back this morning to start work on the site and SEOMoz has crawled the site again, this time returning only 1 page and 0 errors. I haven't even logged in to the site since the first crawl, so I couldn't have broken anything. Has anyone seen this before?
Moz Pro | | Junction0 -
Crawl reports, date/time error found
Hello! I need to filter out the crawl errors found before a certain date/time. I find the date and time the errors were discovered to be the same. It looks more like the time the report was generated. Fix?
Moz Pro | | AJPro0 -
How often does seo moz update its link data?
I have lots of recently gained good links that don't show in seo moz, how long does it take for moz trust, moz rank and PR to update?
Moz Pro | | myloseo0