Site Crawler Tool by the Company Formerly Known As SEOMoz
-
Moz had a tool I used that would crawl my site and send me a report of all pages, all errors, 301s 404s 505s, and a whole plethora of stuff. I used it to fix pesky errors quite a bit. Does this still exist? Was it replaced or am I just not finding it in the new design?
-
That's the one.
Moz... Take note this is a great tool. Place it somewhere friendly!
-
You sir, now have a plaque in the offices of drumBEAT.
Best and Thanks! -
There is no easy way to get there currently. Right after the Moz redesign, someone had asked how to find it and I saved the URL from the answer just in case.
-
Mike,
I am impressed, how did you get there on the new site?
Thanks -
Are you referencing this crawl tool? http://pro.moz.com/tools/crawl-test
-
This is still there. Look under your Campaigns (Button on the top right) and select the site/campaign from the list you want to review. Once within a campaign, click on "Crawl Diagnostics" in the subnav. I like to export to CSV to look through things - but this is all there.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Search volume discrepancies between keyword tools
I'm feeling like I'm basing all my research time on tools that I cannot necessarily trust. Between Google keyword planner, Keywords everywhere chrome extension, and Moz keyword explorer, I'm getting wildly different results on 2 simple keywords related to colleges with baking & pastry arts degrees. "baking college", "baking colleges" So Keyword planner won't give me any search volume for those 2 words, I don't even see them in the results. Instead, it decides I really meant "baker college" which has 33,100 global searches. I tried telling it use only closely related terms, but it keeps giving me "baker college" and refuses to show me the terms I asked for. Stubbornly useless. Keywords everywhere says both of these keywords bring in 33,100 searches. It does not tell me those searches were for "baker college." Totally misleading. Moz keyword explorer says baking college as 0-10 volume, baking colleges has 101-200 volume. So at least it's not trying to give me "baker college" numbers. Perhaps I can trust this, but it's not convenient to upload hundreds of various keywords at a time to pull the volume numbers like I do with the other tools. With Keyword planner making assumptions and grouping unrelated terms together, and Keywords everywhere using those numbers without pointing out the assumptions, I feel like I can't trust anything without taking time to dig into the discrepancies, which is impossible with hundreds of keywords. Do you know of any good search volume tools that don't force or hide assumptions? Thanks.
Moz Bar | | JannetteP1 -
Need to solve "Oops our crawlers were unable to access" url for new campaign
I'm putting the url designfirstkitchenandbath.com and getting the "oops! our crawlers were unable to access the site. Since this site is a potential client, which shows up online, I can't get access to fix the code, plus while I can write a little html I don't feel comfortable working with hard, live code on someonelse's site. Anyone have a simple solution?
Moz Bar | | alisacromer0 -
Rogerbot will not crawl my site! Site URL is https but keep getting and error that homepage (http) can not be accessed. I set up a second campaign to alter the target url to the newer https version but still getting the same error! What can I do?
Site URL is https but keep getting and error that homepage (http://www.flogas.co.uk/) can not be accessed. I set up a second campaign to alter the target url to the newer https://www.flogas.co.uk/ version but still getting the same error! What can I do? I want to use Moz for everything rather than continuing to use a separate auditing tool!
Moz Bar | | digitalascend0 -
Error 406 with crawler test
hi to all. I have a big problem with the crawler of moz on this website: www.edilflagiello.it. On july with the old version i have no problem and the crawler give me a csv report with all the url but after we changed the new magento theme and restyled the old version, each time i use the crawler, i receive a csv file with this error: "error 406" Can you help me to understan wich is the problem? I already have disabled .htacces and robots.txt but nothing. Website is working well, i have used also screaming frog as well.
Moz Bar | | ArchieDonnithorne1 -
Error 4XX showing by SEOmoz tool
Hi, I am a SEOmoz user. Can anybody guide me how to fix 4XX errors as i got reported by "Crawl Diagnostics Summary". There are many referring URLs reporting same error. Please guide me what to do and how to fix it?? Thanks
Moz Bar | | acelerar0 -
Unsure on Keyword Difficulty Tool
Hi all. I am just using the Keyword Difficulty tool for the first time really, in the Research Tools section. Just finding my way around and was wondering why when i enter my keywords for analysis and select Google, UK as my search engine parameters i get BING local and global search volume rather than Google? Many thanks in advance, any help is appreciated 🙂
Moz Bar | | K-Taz0 -
Bing data in the keyword difficulty and SERP analysis tool
Hi Guys, I'm wondering about the exact match bing data in the Moz KWD & SERP analysis tool. We're looking at the ranking difficulty for given terms in Google but getting exact match bing numbers. Is the tool estimating Google searches from the bing data (perhaps a simple formula assuming maybe 10% search totals for Bing, 60% for Google or whatever is closest these days) or is it just raw bing numbers that we then have to upsize in order to estimate search numbers in Google? Hope that makes some kind of sense! In other words - how are you guys using that Bing data when considering terms to target using this tool? Look forward to hearing your thoughts.
Moz Bar | | lovealbatross
Cheers
James0 -
Screaming Frog, Moz and other crawlers
Hi Ignorant question, but is it possible to use Screaming Frog or the Moz crawler or any other reputable crawler for a site still in development i.e. it is yet to be indexed? If so, could someone provide some quick instructions on how this can be done. Thanks in advance for any support. Neil
Moz Bar | | mccormackmorrison0