Schedule crawls for 2 subdomains every 24 hours
-
I saw at this link:
http://pro.seomoz.org/tools/crawl-test
"As a PRO member, you can schedule crawls for 2 subdomains every 24 hours, and you'll get up to 3,000 pages crawled per subdomain."
However I am having trouble finding where to schedule this 24 hour crawl in my Pro Dashboard. I did not see the option for this setting in the crawl diagnostics tab or in the campaign settings section from the dashboard home page. Can you help?
thanks!
Michael
-
Generally, I correct the error and then wait until the next crawl if I'm confident that I've fixed the problem.
If I'm unsure then I may run a manual crawl using the crawling tool, however for me the format just isn't as easy to read as the weekly crawl diagnostics.
-
Interesting, thank you both for the feedback. I am new to SEOMoz and am just curious how most users use the crawl tool when they fix errors...do you wait until the next week's crawl to see if the error is resolved? or do you immediately use the crawl test tool to check and see if their changes corrected the errors..(saving time) No right or wrong answer here, just curious as to how most SEO Moz pro users the tool. Any tips or tricks from other users on how they use the tool no matter how big or small would be greatly appreciated! thanks
-
Shelly is right on here. Send an email to help@seomoz.org and they'll answer your question for you.
-
You can use the crawl test tool to run a 2 crawls per day for up to 3,000 pages, however as far as I'm aware the SEO Tools are moving more towards campaign setups where your sites are crawled once per week (or within 24 hours for a new campaign).
It might be worth referring a request to SEOMoz help to get the team to clarify
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does MOZ still do deep crawls of the website?
In the past you could get MOZ to crawl your website, now I don't see this option, no do I see a crawl at the beginning of the month. Has this change? I saw this as a useful feature.
Moz Pro | | cdgospel0 -
1 page crawled - again
Just had to let you know that it happend again. So right now we are at 2 out of the last 4 crawls. Uptime here is 99,8% for the last 30 days, with a small downtime due to an update process at the 18/5 from around 2:30 to 4:30 GMT In relation to: http://moz.com/community/q/1-page-crawled-and-other-errors
Moz Pro | | alsvik0 -
OSE Domains & Subdomains
Is there a compelling reason that OSE treats subdomains as part of a parent domain, rather than as a separate site? Or is this just a technical limitation? I ask because it's my understanding that Google treats subdomains more like separate domains than like parts of the parent domain. OSE treating them more like folders creates some frustrating situations when researching niches that are heavily filled with blospot and wordpress.com blogs. First of all, the domain authority in these situations is not at all indicative of the strength of the site. It also makes it hard to evaluate linking root domains at a glance, since all blogspot blogs count as one domain. So to see all blogspot sites linking you have to go to the full link list -- where each site may be listed hundreds of times -- and you can't group them because they're all considered the same domain. To be sure you when researching these niches you can just throw out domain authority as a metric, and export every report to excel where you can sort things in a way to make it easier to separate sites. But if there isn't a compelling SEO reason to have OSE function this way, I'd love to see those subdomains treated as separate sites so I can have access to all the easy to use SEOmoz metrics and layouts without the extra work. And of course if there is a compelling SEO reason for subdomains to be treated as domains, I'd love to be educated! : )
Moz Pro | | Ecreativeworks0 -
Crawl Test produced only 1 page
Hi, I recently submitted a crawl for www.cirrato.com using SEOMoz Crawl Test Tool. I have a lot of pages, but the crawl result shows only 1 page, which is the front page and nothing else... Does anyone know what this could mean or what the problem is?
Moz Pro | | yusufcirrato0 -
Crawling One Page
I set up a profile for a site with many pages, opting for setting up as a root directory. When SEOMoz crawled, they only found one page. Any ideas for why this would be? Thanks!
Moz Pro | | Group160 -
How do I get my crawl report?
I received a message that my crawl report is complete with a link - went to the link however - when I click on the icon that has the report name and the complete check mark nothing happens looked around can't find the results. Need to bid on this job so it would be helpful to know where to get it. Thanks for all you do. Wickey
Moz Pro | | Wickey0 -
Why is Roger crawling pages that are disallowed in my robots.txt file?
I have specified the following in my robots.txt file: Disallow: /catalog/product_compare/ Yet Roger is crawling these pages = 1,357 errors. Is this a bug or am I missing something in my robots.txt file? Here's one of the URLs that Roger pulled: <colgroup><col width="312"></colgroup>
Moz Pro | | MeltButterySpread
| example.com/catalog/product_compare/add/product/19241/uenc/aHR0cDovL2ZyZXNocHJvZHVjZWNsb3RoZXMuY29tL3RvcHMvYWxsLXRvcHM_cD02/ Please let me know if my problem is in robots.txt or if Roger spaced this one. Thanks! |0 -
The Site Explorer crawl shows errors for files/folders that do not exist.
I'm fairly certain there is ultimately something amiss on our server but the Site Explorer report on my website (www.kpmginstitutes.com) is showing thousands of folders that do not exist. Example: For my "About Us" page (www.kpmginstitutes.com/about-us.aspx), the report shows a link: www.kpmginstitutes.com/rss/industries/404-institute/404-institute/about-us.aspx. We do have "rss", "industries", "404-institute" folders but they are parallel in the architecture, not sequential as indicated in the error url. Has anyone else seen these types of error in your Site Explorer reports?
Moz Pro | | dturkington0