How do i get the crawler going again?
-
The initial crawl only hit one page. Set up another campaign for another site and it crawled 260 pages.
How can I get the crawler started up again or do I really have to wait a week ?
-
It's easiest for the Moz team to respond to individual questions like this via an email to help@seomoz.org or sending in a ticket through the help hub at seomoz.org/help.
-
Hi Keri,
Yeah, I've followed these steps. htaccess forwards to www if none and my campaign is using www.
The robots.txt is available in browser no problem.
my htaccess had massive country ip blocks as well as amazonaws..
I've removed all blocks that arent china or amazon.
Still waiting on a response from the MOZ team here on how to get the real crawl going as what I found in tools is not the same as the weekly scan.
-
Also, for why we only crawled one page, check out https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages- for some helpful tips.
-
Whenever you have crawl issues, the SEOMoz help team is the place to go. They're the only ones who can look into your account to see if there's an issue or such. (And they are really nice and quick to respond.)
-
Research Tools > Crawl Test at bottom left of page.
Not sure why it's taken me 2 days to find that but it did.
Thanks. Sorry for the dumb question...
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
MOZ Crawler
Hi, how much time it will take MOZ crawler to take entire site? In 24 hours it crawled only 500 pages isn't it too slow? My website has almost 50k pages.
Moz Pro | | macpalace0 -
Exit Rates and where people go
Hello Mozzers, Where can I analyze where people go after they exit a website in GA. Are there any other free tools/ paid tools that will help me see which site people go to when they bounce of a website. I am specifically in need of help to know where visitor go "outside" of my site without clicking and out bound links that are on the website. Thank you for helping, Grateful to the community as usual, Vijay
Moz Pro | | vijayvasu0 -
Wher is the API id and key? I tried generating it several times but I get nothing...?
Wher is the API id and key? I tried generating it several times but I get nothing...?
Moz Pro | | breezego0 -
How to get the total external links to a page and total external links to the domain using Mozscape API? I could not see an option in the bit flags
Hi, I was trying to get the data for total external links to a page and total external links to the domain using Mozscape API but I can't see a bit flag which can do that. There are bit flags for external followed links to a page and external followed links to a domain but I wanted the total external links data, is there a way to do that using Mozscape API else I would end up copying the data manually from OSE which would be cumbersome and time consuming. Your help is highly appreciated.
Moz Pro | | HQP0 -
What should be cols value if I want to get Backlinks?
Hi, I am forming below url to get backlinks. http://lsapi.seomoz.com/linkscape/url-metrics/".$trimurl."?Cols=2048 &AccessID=".$accessID." &Expires=".$expires." &Signature=".$urlSafeSignature; For Example, if I keep $trimurl = "www.tatvic.com/" , I get [uid] => 633. Is this a right way to get number of backlinks ? If not, what should be the 'Cols' value? Also, how can I ensure that the number of links I am getting is correct ? Is there any way to compare this number with Google search results? This is very essential to check as I got different number of backlinks on different APIs. Thank you.
Moz Pro | | Ravi_Pathak0 -
SEOmoz crawler bug?
I just noticed that a few of my campaigns have number of pages crawled 1. Can someone tell me what this is.... from 5 campaigns 2 have only one pages crawled from which one is an online shop with over 2000 products 🙂
Moz Pro | | mosaicpro0 -
How can I get ranking keys of competitors
Sometimes it might be clever to analyse the stategy of a competitor to see with which keys they rank successfully. For example I have a webshop, so I type in amazon.com and seomoz spits out: books, dvds, ... I can now see with what keys i wont have a chance and can think of missing keys where my chance might be. Is there a possibility to find out with seomoz?
Moz Pro | | SEOBavaria820 -
Still Getting Keyword Self-Cannibalization
I used the onsite optimization and made some changes to my post, but am still getting the Self-Cannibalization mention in my results. It lists this: "Real Estate Careers | Keller Williams | Career In Real Estate" as the link that is not supposed to be there. This is not a link, but the title of the post. What am I missing?
Moz Pro | | brentmitchell0