Campaign Not Crawling
-
I set up my first 5 campaigns and one is not crawling beyond one-page. It's been over 48 hours.
This site has nearly 3.500 pages the others much less, however, this shouldn't make any difference.
I searched for the problem and couldn't find it so I hope this question isn't redundant.
Comments and advice would be appreciated.
-
OOHH-LA-LA
That pesky Amazon cloud. Maybe a big Bingo. I will remove the blocked IPs from Amazon hosting. I had someone from those IPs slamming Google Ads so I blocked a big range all related to Amazon.
If the problem exists I'll reconstitute the block but for now let's see if removing them helps.
OK - I removed the motherload of IPs and I will come back and respond to the result after about 48 hours or sooner if I see positive results.
UPDATE: After removing the blocked IPs the site was crawled the max 10K pages.
UPDATE 2: The Adsense slammer returned under several different Amazon Cloud IPs so I had to block the full range again as I don't want to get banned by Google. No money registered only numerous ad clicks. This is unacceptable so I won't crawl this site.
Thanks,
Don
-
Hi Don,
So sorry to hear about the problems. Check out this help topic addressing what to do when only one page is crawled. If that doesn't solve your problem, send an email to help@seomoz.org
http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page
-
Ah, ok, sorry - I misread your question Don.
I think I had the same problem with a campaign for a while, luckily it wasn't urgent so I left it, but it took a while to sort itself out
-
Hi Shelly:
The other 4 campaigns look to have gone through that starter crawl just fine, ergo, my question about that 5th campaign. I suppose if I don't see any action in a couple of more days I will indeed direct a question to the SEOMoz team but will leave this question open for a while also.
Thanks.
-
As I understand it, it takes a week for a complete crawl to be carried out on any new campaigns, but you now get a starter crawl when setting up a campaign - the starter crawl isn't as comprehensive and may explain why your sites haven't been crawled properly yet.
It may be worth directing a request to the SEOMoz team via the help function
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Functionality of SEOmoz crawl page reports
I am trying to find a way to ask SEOmoz staff to answer this question because I think it is a functionality question so I checked SEOmoz pro resources. I also have had no responses in the Forum too it either. So here it is again. Thanks much for your consideration! Is it possible to configure the SEOMoz Rogerbot error-finding bot (that make the crawl diagnostic reports) to obey the instructions in the individual page headers and http://client.com/robots.txt file? For example, there is a page at http://truthbook.com/quotes/index.cfm month=5&day=14&year=2007 that has – in the header -
Moz Pro | | jimmyzig
<meta name="robots" content="noindex"> </meta name="robots" content="noindex"> This page is themed Quote of the Day page and is duplicated twice intentionally at http://truthbook.com/quotes/index.cfm?month=5&day=14&year=2004 and also at http://truthbook.com/quotes/index.cfm?month=5&day=14&year=2010 but they all have <meta name="robots" content="noindex"> in them. So Google should not see them as duplicates right. Google does not in Webmaster Tools.</meta name="robots" content="noindex"> So it should not be counted 3 times? But it seems to be? How do we gen a report of the actual pages shown in the report as dups so we can check? We do not believe Google sees it as a duplicate page but Roger appears too. Similarly, one can use http://truthbook.com/contemplative_prayer/ , here also the http://truthbook.com/robots.txt tells Google to stay clear. Yet we are showing thousands of dup. page content errors when Google Webmaster tools as shown only a few hundred configured as described. Anyone? Jim0 -
First Campaign: No email when each step is completed?
I joined SEOMoz 6 days ago and set up my first campaign straight away. On my Campaign Overview, it says: "Here's what you can expect over the coming days (we'll send you an email when each step is completed". But I've not received an email saying that any of the steps are completed, so I haven't really used any of the tools yet as I wanted to wait until I had something to work with 🙂 Since it's almost been 7 days (will be 7 tomorrow), do I assume that most if not all of the stages have now been completed and I can get started? Thanks, Iain.
Moz Pro | | iainmoran0 -
Can we add sites to the crawl queue for OSE?
Is it possible to request that Open Site Explorer crawls a new URL on its next run? This tool is the first place I go to when working on a new site, and when there is "No Data Available" this is a little frustrating. I fully appreciate that this lack of data is usually a signal that the website is either very new or of low quality, however that if often the reason that I am brought in and would very much like to benchmark and provide initial analysis using this tool. It would make sense that OSE crawls the sites that Moz members are working on wouldnt it? Scott.
Moz Pro | | eseyo0 -
Drop in Number of Crawled pages by SEOMOZ?
I noticed that the number of Crawled Pages on my website has been 2 pages only over past week. Before that the number of crawled pages was over 1000. My site has numerous pages as it is a Travel website that pulls search results for Flights, Cars, Hotels, Cruises and Vacation packages so there is a huge Database there. Can someone help? Thanks !
Moz Pro | | sherohass0 -
Is it possible to do the comparision between a subfolder against a subdomain at SEOmoz campaign tool?
Is it possible to do the comparision between a subfolder against a subdomain at SEOmoz campaign tool? For instance: - I have a client who uses a subdomain model to render your homepage and he has a competitor hosted in a subfolder. It appears to be impossible to do that kind of comparision at the SEOmoz campaign tool. Do you have some other way to do that?
Moz Pro | | Abril0 -
Sub-domain not crawled
One of our sites was recently re-designed. The home page is a landing page (www.labadieauto.com) and I moved the blog to this domain (labadieauto.com/blog/) and put a link is the bottom left of the home page. Since the change the SEOMOZ campaign overview is showing only 1 page crawled. This is not setup as a sub-domain so why isn't it showing in the crawl? Help!
Moz Pro | | LabadieAuto0 -
SEomoz slow to crawl?
Hello - I am just trying out the trial and it said the next crawl was nov 1st but I see no change in any of the errors since the initial crawl... so just waiting to find out if what I changed was fixed or not. Is this normal ?
Moz Pro | | Bethany_BabyBrowns0 -
My Campaign just picked up the .com.au site and is showing data
I've got a campaign set up here in SEOmoz and it appears that it just started picking up data for a site that is not mine. Our site is examplesite.com and i noticed that SEOmoz has begun including examplesite.com.au and is showing 20,000 302's from this site. The .com.au site is in no way related to our business and should not be tracked in our campaign. Has this happened to anyone else?
Moz Pro | | WP_SEO0