Crawl test tool from SEOmoz - which URLs does it actually crawl?
-
I am using for the first time the crawl test tool from SEOmoz and I do not really understand which URLs the tool is going to crawl.
First, it says "enter any subdomain" --> why can´t I do the crawl for the root domain?
Second it says "we'll crawl up to 3,000 linked-to pages" --> does that mean that the tool crawls all internal links that it can find on the given domain?
Thanks for your help!
-
Hi Elke,
An initial Pro campaign will take up to 7 days to complete and will crawl up to a maximum 10,000 URLs for the root domain or sub domain that you choose to set it up for.
The Crawl Test tool is intended to provide a "quick start " option, which will report against the same diagnostic information, but for a limited number of URLs (3,000 & max of 2 domains per day). This allows you to get started on tidying up site issues while waiting for the full crawl to complete.
Since the Crawl Test tool allows you to run the quick crawl for any subdomain, it can also be useful for taking a look at the health of established sites you may be quoting on etc.
Hope that helps,
Sha
-
Alan, thank you for the answer. I am a Pro Member (trial version). But the only crawl diagnostics that I can find inside my campaign is a short Crawl Diagnostics summary which doesn´t include all the information that the crawl test tool gave me... I have just set up a campaign for the root domain, let´s see if the crawl diagnostics give me more information for that one.
-
When you become a pro meneber you can set up compaigns, then you can set up by root domain and crawl all sub domains.
the free version will crawl only one sudomain, such as
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Good ranking tool for RU?
I use SEOMoz to track my rankings in RU, but there are a few problems: 1 - SEOMoz doesnt offer Yandex tracking 2 - When exporting rankings to CSV it only shows the keywords in EN characters and looks something like this ??asad&$ Any suggestions for a better tool to use for RU? Thanks!
Moz Pro | | theLotter0 -
Joined SEOMOZ but non changed.
hi. i am new SEOMoz and i joined pro monthly and create 2 campagnes but there are every thing shows me 0 and i guess nothing changed with before.. please see this.. | | StickerApt |
Moz Pro | | bratt
| Domain Authority | 1 |
| Domain MozRank | 0.00 |
| Domain MozTrust | 0.00 |
| External Followed Links | 0 |
| Total External Links | 0 |
| Total Links | 0 |
| Followed Linking Root Domains | 0 |
| Total Linking Root Domains | 0 |
| Linking C-Blocks | 0 |
| Followed Links
vs
NoFollowed Links****Followed Linking Root Domains
vs
NoFollowed Linking Root Domains | | ubdomain Metrics | canadastickerking | stickeryou | stickybusiness |
| 4.31 | Transparent 5.26 | 4.56 |
| 3.78 | Transparent 5.43 | 4.87 |
| 71 | Transparent 38,649 | 631 |
| 73 | Transparent 38,814 | 1,265 |
| 3,805 | Transparent 235,124 | 26,337 |
| 7 | Transparent 243 | 115 |
| 7 | Transparent 286 | 161 |
| | | | | | StickerApt |
| Subdomain MozRank | 0.00 |
| Subdomain MozTrust | 0.00 |
| External Followed Links | 0 |
| Total External Links | 0 |
| Total Links | 0 |
| Followed Linking Root Domains | 0 |
| Total Linking Root Domains | 0 |
| Followed Links
vs
NoFollowed Links****Followed Linking Root Domains
vs
NoFollowed Linking Root Domains | "No followed (0%)"
"No nofollowed (0%)" | Total Branded Keywords Manage brand rules Non-branded Keywords Week ending: 9/9 Change 9/16 9/9 Change 9/16 9/9 Change 9/16 --- --- --- --- --- --- --- --- --- --- Organic Search Visits 45 -18% 37 7 -14% 6 38 -18% 31 URLs Receiving Entrances Via Search 8 25% 10 4 -50% 2 4 100% 8 | Non-Paid Keywords Sending Search Visits | 20 | -10% | 18 | 6 | -33% | 4 | 14 | 0% | 14 | can any one help me what should i do with SEOMoz? all the keyword i set up tells me not in top 50 ranking.. i set up 12keyword for start.. and aslo i there is craw erros on my site but it can not be fixed because the page that getting erros are automatic quote pages and made php. and it should be duplicate pages it share with other pages, hard to explain.. but you will see what i am talking about it has duplicate title and content.. it should be like that.. http://www.stickerapt.com/quote.php i can not change duplicate erros is it gonna effect page rank? please help..ㅡㅡ0 -
SeoMoz and incorrect results?
Just recieved my weekly Rankings and On Page report. First thing i noticed is that an important keyword dropped big time. "Rejser til Cypern" dropped from #3 to #40 ... So i checked google.dk myself (using impersonal.me) and saw i was still #3 in SERP. I ran SeoMoz's own Keyword Difficulty Report-tool. It showed me i was #3 in SERP. Now im thinking: Did i just loose my trust in Seomoz, to whom i give access to all my GA-data? What to do? Have anyone else experienced this?
Moz Pro | | alsvik0 -
Crawl Disgnosis only crawling 250 pages not 10,000
My crawl diagnosis has suddenly dropped from 10,000 pages to just 250. I've been tracking and working on an ecommerce website with 102,000 pages (www.heatingreplacementparts.co.uk) and the history for this was showing some great improvements. Suddenly the CD report today is showing only 250 pages! What has happened? Not only is this frustrating to work with as I was chipping away at the errors and warnings, but also my graphs for reporting to my client are now all screwed up. I have a pro plan and nothing has (or should have!) changed.
Moz Pro | | eseyo0 -
Crawl Diagnostics Report
I'm a bit concerned about the results I'm getting from the Crawl Diagnostics Report. I've updated the site with canonical urls to remove duplicate content and when I check the site - it all displays the right values, but the report, which has just finished crawling is still showing a lot of pages as duplicate content. Simple example: http://www.domain.com http://www.domain.com/ Both of them are in the duplicate content section although both have canonical url set as: Does each crawl check the entire site from the beginning or just the pages it didn't have a chance to crawl the last time? This is just one of 333 duplicate content pages, which have canonical url pointing to the right page. Can someone please explain?
Moz Pro | | coremediadesign0 -
How to remove Duplicate content due to url parameters from SEOMoz Crawl Diagnostics
Hello all I'm currently getting back over 8000 crawl errors for duplicate content pages . Its a joomla site with virtuemart and 95% of the errors are for parameters in the url that the customer can use to filter products. Google is handling them fine under webmaster tools parameters but its pretty hard to find the other duplicate content issues in SEOMoz with all of these in the way. All of the problem parameters start with ?product_type_ Should i try and use the robot.txt to stop them from being crawled and if so what would be the best way to include them in the robot.txt Any help greatly appreciated.
Moz Pro | | dfeg0 -
Why are SEOmoz Pro Keyword Ranking reports different between two 301-linked URLs?
Hi, My main domain is www.dancenut.com. I have this 301 URL redirected to www.dancenut.com/boston/. I set up an SEOmoz Pro campaign for each of these URLs in order to see if they were being treated differently in any way. In most cases the report results are identical, or the small differences are understandable. However, there is one big difference between the two sets of campaign reports. In the Keyword Ranking reports, the data for the Bing and Yahoo! reports are identical, but the data for the Google reports are dramatically different. Out of 21 keywords, 9 are listed in the top 50 for www.dancenut.com, but only 2 are listed in the top 50 for www.dancenut.com/boston/ (the specific positions are the same for the 2 keywords that are listed for both). Does this make any sense? Could the SEOmoz Pro data be wrong? If not, then I'm suspicious that Google may not be interpreting the 301 redirect properly. I don't think this could be fully explained by a 1-10% reduction in link juice due to the 301 because I have one keyword for which my site ranks #1 in Google, Bing, and Yahoo! with www.dancenut.com, but it doesn't even rank in the top 50 in Google with www.dancenut.com/boston/. And why would these differences only exist for Google? Any insight would be much appreciated! Andrew
Moz Pro | | dancenut0 -
Errors on my Crawl Diagnostics
I have 51 errors on my Crawl Diagnostics tool.46 are 4xx Client Error.Those 4xx errors are links to products (or categories) that we are not selling them any more so there are inactive on the website but Google still have the links. How can I tell Google not to index them?. Can those errors (and warnings) could be harming my rankings (they went down from position 1 to 4 for the most important keywords) thanks,
Moz Pro | | cardif0