Crawl Test produced only 1 page
-
Hi, I recently submitted a crawl for www.cirrato.com using SEOMoz Crawl Test Tool. I have a lot of pages, but the crawl result shows only 1 page, which is the front page and nothing else...
Does anyone know what this could mean or what the problem is?
-
Ok Yusuf, if you blocked all robots than seomoz wouldn't be able to crawl your site.
if you are still working on the website, there is a way to block search engine but let Seomoz robot to cawl the website
let us know if you have a problem with that )
-
Thanks for your comment. I checked my robots.txt as you said and it was set for:
Disallow: *
That was probably the problem. I'm going to do a new crawl and see if the problem remains. I'll let you know here afterwards.
Again, thanks for the comment.
-
what is the url? is everything ok with robots.txt ? i've never experienced that on my campaigns, i'd be curious to take a look
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Why does Moz Crawler start with HTTP//1.1 version??
We have run Moz Pro's Site Crawl for example-domain.com Why has Moz's crawler decided to site http://www.example-domain.com (ie the non-secure version) as zero crawl depth page and report the actually live https://www.example-domain.com (ie secure HTTP2 version) as a crawl depth of 2? Surely the main live page should be the first crawled and reported as crawl depth = 0?
Moz Pro | | AKCAC0 -
moz crawl is stopped?
moz stopped indexing the links due to some updates? can some one confirm me thanks
Moz Pro | | 42409300125323700 -
PR2 vs Page Authority 65
Looking at a website that has a Google Toolbar rank of 2. Moz Authority is 65. Why would there be such a huge difference? Site has been around since 2000 but has not been updated. Mosst of the links are from 3000 links all owned by the same person.
Moz Pro | | Ebtec0 -
F rated page appearing higher than A rated page
Hi, We have a page that we have optimised in the MOZ system and got a grade A for the term "Dental Implants Wolverhampton" The page that has been optimised isn't being indexed in google http://www.perfectdental.eu.com/treatments-implants.php However, this page http://www.perfectdental.eu.com/uk-clinics-dental-team.php Which hasn't been optimised is indexed 11. If i run this page through the MOZ "on-page checker" it receives a quality score of F. Its very confusing, would be great to hear from anyone with any ideas? Thanks
Moz Pro | | popcreativeltd
Ade0 -
Concerned About Individual Pages
Okay. I've setup a campaign for www.site.com and given a list of keywords. So after the initial crawl we'll have some results. What I'm looking for tho is how do individual pages on my site rank for the list of keywords given. And then be able to go to a screen in seomoz with data for that particular page with recommendations and stuff like that. Is this what's going to happen or do I need to create a campaign for each url i want to track? If all will work as I'd like in the example above, should I then add the second list of keywords that some other pages should rank for? Will it get to be a big mess or can I relate the keywords to pages in some way? It seems like what I'm looking for is what this program should be... Thanks!
Moz Pro | | martJ0 -
Current on-page best practices
Given all the recent talk about over optimization, when was the last time SEOMoz updated the on-page report card tool? Rand wrote an excellent piece on Perfect On-Page Optimization (which is great, and thanks) in summer 2009. Is that still best practice 3 years later (and post-Penguin/Panda)? If not, has the SEOMoz on-page report card tool been updated to reflect current thinking for on-page best-practices? I know the higher level concept is "write for humans, not for bots" but if you can do both (and not create an unreadable seo-frankenpage) then why not? Does getting an "A" grade wreak of over optimization now? Should I use the key phrase at the start of the title, h1, and strong (or bold) elements on a page? Should have an image with file name and alt text equal to (or containing at the start) the key phrase?
Moz Pro | | scanlin2 -
Crawl still in progress ...
Hi guys, New crawl on one of my campaigns is still in progress since November 27th, i didn't get new data since November 19th 2011 ... What should i do ?
Moz Pro | | DavidEichholtzer0 -
Sub-domain not crawled
One of our sites was recently re-designed. The home page is a landing page (www.labadieauto.com) and I moved the blog to this domain (labadieauto.com/blog/) and put a link is the bottom left of the home page. Since the change the SEOMOZ campaign overview is showing only 1 page crawled. This is not setup as a sub-domain so why isn't it showing in the crawl? Help!
Moz Pro | | LabadieAuto0