Crawl test tool from SEOmoz - which URLs does it actually crawl?
-
I am using for the first time the crawl test tool from SEOmoz and I do not really understand which URLs the tool is going to crawl.
First, it says "enter any subdomain" --> why can´t I do the crawl for the root domain?
Second it says "we'll crawl up to 3,000 linked-to pages" --> does that mean that the tool crawls all internal links that it can find on the given domain?
Thanks for your help!
-
Hi Elke,
An initial Pro campaign will take up to 7 days to complete and will crawl up to a maximum 10,000 URLs for the root domain or sub domain that you choose to set it up for.
The Crawl Test tool is intended to provide a "quick start " option, which will report against the same diagnostic information, but for a limited number of URLs (3,000 & max of 2 domains per day). This allows you to get started on tidying up site issues while waiting for the full crawl to complete.
Since the Crawl Test tool allows you to run the quick crawl for any subdomain, it can also be useful for taking a look at the health of established sites you may be quoting on etc.
Hope that helps,
Sha
-
Alan, thank you for the answer. I am a Pro Member (trial version). But the only crawl diagnostics that I can find inside my campaign is a short Crawl Diagnostics summary which doesn´t include all the information that the crawl test tool gave me... I have just set up a campaign for the root domain, let´s see if the crawl diagnostics give me more information for that one.
-
When you become a pro meneber you can set up compaigns, then you can set up by root domain and crawl all sub domains.
the free version will crawl only one sudomain, such as
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawlers crawl weird long urls
I did a crawl start for the first time and i get many errors, but the weird fact is that the crawler tracks duplicate long, not existing urls. For example (to be clear): there is a page: www.website.com/dogs/dog.html but then it is continuing crawling:
Moz Pro | | r.nijkamp
www.website.com/dogs/dog.html
www.website.com/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dogs/dogs/dog.html what can I do about this? Screaming Frog gave me the same issue, so I know it's something with my website0 -
Joined SEOMOZ but non changed.
hi. i am new SEOMoz and i joined pro monthly and create 2 campagnes but there are every thing shows me 0 and i guess nothing changed with before.. please see this.. | | StickerApt |
Moz Pro | | bratt
| Domain Authority | 1 |
| Domain MozRank | 0.00 |
| Domain MozTrust | 0.00 |
| External Followed Links | 0 |
| Total External Links | 0 |
| Total Links | 0 |
| Followed Linking Root Domains | 0 |
| Total Linking Root Domains | 0 |
| Linking C-Blocks | 0 |
| Followed Links
vs
NoFollowed Links****Followed Linking Root Domains
vs
NoFollowed Linking Root Domains | | ubdomain Metrics | canadastickerking | stickeryou | stickybusiness |
| 4.31 | Transparent 5.26 | 4.56 |
| 3.78 | Transparent 5.43 | 4.87 |
| 71 | Transparent 38,649 | 631 |
| 73 | Transparent 38,814 | 1,265 |
| 3,805 | Transparent 235,124 | 26,337 |
| 7 | Transparent 243 | 115 |
| 7 | Transparent 286 | 161 |
| | | | | | StickerApt |
| Subdomain MozRank | 0.00 |
| Subdomain MozTrust | 0.00 |
| External Followed Links | 0 |
| Total External Links | 0 |
| Total Links | 0 |
| Followed Linking Root Domains | 0 |
| Total Linking Root Domains | 0 |
| Followed Links
vs
NoFollowed Links****Followed Linking Root Domains
vs
NoFollowed Linking Root Domains | "No followed (0%)"
"No nofollowed (0%)" | Total Branded Keywords Manage brand rules Non-branded Keywords Week ending: 9/9 Change 9/16 9/9 Change 9/16 9/9 Change 9/16 --- --- --- --- --- --- --- --- --- --- Organic Search Visits 45 -18% 37 7 -14% 6 38 -18% 31 URLs Receiving Entrances Via Search 8 25% 10 4 -50% 2 4 100% 8 | Non-Paid Keywords Sending Search Visits | 20 | -10% | 18 | 6 | -33% | 4 | 14 | 0% | 14 | can any one help me what should i do with SEOMoz? all the keyword i set up tells me not in top 50 ranking.. i set up 12keyword for start.. and aslo i there is craw erros on my site but it can not be fixed because the page that getting erros are automatic quote pages and made php. and it should be duplicate pages it share with other pages, hard to explain.. but you will see what i am talking about it has duplicate title and content.. it should be like that.. http://www.stickerapt.com/quote.php i can not change duplicate erros is it gonna effect page rank? please help..ㅡㅡ0 -
What web page and domain analysis / error checking / testing tools do you use for competitor analysis? sites like webpagetest
Just wondering what everyone is using, I am looking to get as much insight and detail as I can on websites that are not currently being monitored by me... i.e. potential clients. I use tools like pagespeed, webpagetest, loadimpact and open site explorer, google adwords, ispionage, alexa, semrush and well, looking for more. I really just want to rip a website to the tiniest pieces possible in an organized and coherent manner... is there anything out there? I have tried several other's which i no longer use (compete, 4q, woopra, nuestar, to name a few), I am not sure if I know exactly what i want, i just want more.... damn the human condition. lol
Moz Pro | | atb9900 -
SEOmoz campaign - keyword rankings...
Hi there, I have a quick question: Does it make a difference if I add keywords to a campaign with the '[' and ']' brackets included? I just realized that I had copy/pasted many of my keywords from the exported CSV from the Google AdWords Keyword Tool and I fear that the keyword rankings on SEOmoz might factor the brackets as part of the keywords themselves. Thanks in advance! Ben
Moz Pro | | BenHammer0 -
Will SEOMoz offer URL data relating to Bot visits
Does SEOMoz in the future plan to report on Bot visits for each URL, when they are spidered and when they appear in for example Google's index ?
Moz Pro | | NeilTompkins0 -
How do you get Mozbot to crawl your website
I trying to get the mozbot to crawl my site so I can get new crawl diagnostics info. Anyone know how this can be done?
Moz Pro | | Romancing0 -
Looking for a tool that can pull OSE stats for a bulk amount of URLs
I know that people have developed inhouse tools with the OSE API that can analyze thousands of URLs and pull metrics like PA, inbound links, etc. I need to analyze about 80k URLs and sort them by authority and I was hoping that someone could point me to a tool that can do this or let me use their tool. I'm willing to pay for access to it. We could build it inhouse, I imagine that it would be pretty easy, but our IT resources are stretched too thin right now.
Moz Pro | | Business.com0 -
Why am I still Unranked in SEOmoz?
I was very active in SEOmoz's Q&A forums today and completed my profile - raising my Moz points from 0 to 50. On my profile, however, I am still listed as Unranked. Also, I do not appear on the SEOmoz Top Members List next to other users with 50 points. I'm guessing this is something that is updated once a day or so, and the rank will update tomorrow. Is my suspicion correct?
Moz Pro | | AnthonyMangia0