Can't Crawl Site - but deducting crawls.
-
Why am I being deducted crawls if MOZ keeps telling me that it can't crawl my site?
-
Any time you initiate a crawl, it counts against your limits, even if something on the site is blocking us from crawling it. I would suggest that write into help@moz.com so we can help you diagnose what is blocking us from crawling your site.
-
Sometimes, when running a crawl on a site (or a section of a site), you may find that it isn’t progressing past the first level of URLs. When this happens, only the base domain, or “start URLs” are actually crawled
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved How can I shorten a url?
I've got way too many long url's but I have no idea how to shorten them?
Getting Started | | laurentjb0 -
I’d like to set up a Moz campaign that crawls just the primary website, not subdomains
Is this something you could help with? (it either bombs or crawls everything, so I assume I’m missing something in the campaign settings, or it’s just not possible.
Getting Started | | blueprintatl0 -
Why wont rogerbot crawl my page?
How can I find out why rogerbot won't crawl an individual page I give it to crawl for page-grader? Google, bing, yahoo all crawl pages just fine, but I put in one of the internal pages fo page-grader to check for keywords and it gave me an F -- it isn't crawling the page because the keyword IS in the title and it says it isn't. How do I diagnose the problem?
Getting Started | | friendoffood0 -
Custom report doesn't list keywords.
I'd like a report which shows a list of all the keywords and their ranks - s it possible to get a complete list in the report rather than just summary of rankings?
Getting Started | | ukandyh0 -
Crawling Website
How often does Moz crawl the website? I have a lot of high priority crawl issues but my web development team says that it fixed them. However, Moz still shows me that none of the errors are fixed.
Getting Started | | Leoni0 -
My site is not being fully crawled
Our site has been crawled several times by RogerBot but each time only 6 pages are crawled even though we have more than 100 pages. Do I need to submit my sitemap.xml to Moz?
Getting Started | | Scurri0 -
What do Pro Subscribers Get that Free Users Don't?
I've been playing with my new account here on Moz, and I'm trying to figure out what Pro subscribers get that Free users don't get. Is there a page somewhere that lists the differences? I Googled, but couldn't find one.
Getting Started | | CharlesSleigh0 -
Oops! This doesn't appear to be a valid URL. Please try again.
Hi everyone! Looking for a bit of help here. This message keeps popping up when I try to put in my url (www.qltyctrl.com). I've tried qltyctrl.com, www.qltyctrl.com, and http://www.qltyctrl.com and nothing works. Can someone help me out here?
Getting Started | | Nimble.Keith0