Campaign Not Crawling
-
I set up my first 5 campaigns and one is not crawling beyond one-page. It's been over 48 hours.
This site has nearly 3.500 pages the others much less, however, this shouldn't make any difference.
I searched for the problem and couldn't find it so I hope this question isn't redundant.
Comments and advice would be appreciated.
-
OOHH-LA-LA
That pesky Amazon cloud. Maybe a big Bingo. I will remove the blocked IPs from Amazon hosting. I had someone from those IPs slamming Google Ads so I blocked a big range all related to Amazon.
If the problem exists I'll reconstitute the block but for now let's see if removing them helps.
OK - I removed the motherload of IPs and I will come back and respond to the result after about 48 hours or sooner if I see positive results.
UPDATE: After removing the blocked IPs the site was crawled the max 10K pages.
UPDATE 2: The Adsense slammer returned under several different Amazon Cloud IPs so I had to block the full range again as I don't want to get banned by Google. No money registered only numerous ad clicks. This is unacceptable so I won't crawl this site.
Thanks,
Don
-
Hi Don,
So sorry to hear about the problems. Check out this help topic addressing what to do when only one page is crawled. If that doesn't solve your problem, send an email to help@seomoz.org
http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page
-
Ah, ok, sorry - I misread your question Don.
I think I had the same problem with a campaign for a while, luckily it wasn't urgent so I left it, but it took a while to sort itself out
-
Hi Shelly:
The other 4 campaigns look to have gone through that starter crawl just fine, ergo, my question about that 5th campaign. I suppose if I don't see any action in a couple of more days I will indeed direct a question to the SEOMoz team but will leave this question open for a while also.
Thanks.
-
As I understand it, it takes a week for a complete crawl to be carried out on any new campaigns, but you now get a starter crawl when setting up a campaign - the starter crawl isn't as comprehensive and may explain why your sites haven't been crawled properly yet.
It may be worth directing a request to the SEOMoz team via the help function
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawl diagnostics up to date after Magento ecommerce site crawl?
Howdy Mozzers, I have a Magento ecommerce website and I was wondering if the data (errors/warnings) from the Crawl diagnostics are up to date. My Magento website has 2.439 errors, mainly 1.325 duplicate page content and 1.111 duplicate page title issues. I already implemented the Yoast meta data plugin that should fix these issues, however I still see there errors appearing in the crawl diagnostics, but when going to the mentioned URL in the crawl diagnostics for e.g.: http://domain.com/babyroom/productname.html?dir=desc&targetaudience=64&order=name and checking the source code and searching for 'canonical' I do see: http://domain.com/babyroom/productname.html" />. Even I checked the google serp for url: http://domain.com/babyroom/productname.html?dir=desc&targetaudience=64&order=name and I couldn't find the url indexed in Google. So it basically means the Yoast meta plugin actually worked. So what I was wondering is why I still see the error counted in the crawl diagnostics? My goal is to remove all the errors and bring it all to zero in the crawl diagnostics. And now I am still struggling with the "overly-dynamic URL" (1.025) and "too many on-page links" (9.000+) I want to measure whether I can bring the warnings down after implementing an AJAX-based layered navigation. But if it's not updating it here crawl diagnostics I have no idea how to measure the success of eliminating the warnings. Thanks for reading and hopefully you all can give me some feedback.
Moz Pro | | videomarketingboys0 -
Crawl Diagnostics
My site was crawled last night and found 10,000 errors due to a Robot.txt change implemented last week in between Moz crawls. This is obviously very bad so we have corrected it this morning. We do not want to wait until next Monday (6 days) to see if the fix has worked. How do we force a Moz crawl now? Thanks
Moz Pro | | Studio330 -
Crawl Test has taken over 5 days and still has yet to complete
I am running some crawls on some sites and I have a number still pending. I have one from 7 days ago, a couple from 6 days ago, and 1 from 5 days ago. The confusing thing is that I have run a few others in that same period that have finished already. Do I need to restart the crawls or cancel them and start over?
Moz Pro | | DRSearchEngOpt0 -
How to setup campaign
Is it better to specify www.site.com or *site.com for SEO Moz campaign? assuming that I do not have any subdomains except www, in the Web Master tools I have selected preferred address as www.site.com and I have redirect in my .htaccess from site.com to www.site.com The reason I am asking is because I see different SeoMoz trust and other stats for root domain and www subdomain. I would think they should be the same, given the fact that I only use www?
Moz Pro | | SirMax0 -
SEOMoz Campaign
Just how lagged are the rankings on SEOMoz Campaigns? They seems to be weeks behind what I actaully see.
Moz Pro | | freestone0 -
How to Stop SEOMOZ from Crawling a Sub-domain without redoing the whole campaign?
I am using SEOMOZ for a client to track their website's performance and fix any errors and issues. A few weeks ago, they created a sub-domain (sub.example.com) to create a niche website for some of their specialized content. However, when SEOMOZ re-crawled the main domain (example.com), it also reported the errors for the subdomain. Is there any way to stop SEOMOZ from crawling the subdomain and only crawl the main domain? I know that can be done by starting a new campaign, but is there any way to work around an existing campaign? I'm asking because we would like to avoid the setting up the campaign again and losing the historical data as well. Any input would be greatly appreciated. Thanks!
Moz Pro | | TheNorthernOffice790 -
Site recently updated- are my campaign results really accurate?
I recently updated a website and it seems as though my campaign results are not accurate. I feel that the more I learn about SEO, the less I know (if that makes sense?). Every time I check my campaign results for this site I feel like I am missing something but just don't know where to begin. The site is aphroditedesserts.com For example, "aphrodite desserts" is one of my keywords. When I type that into Google, it automatically pulls up the site as #1. But in my campaign, it shows that "aphrodite desserts" does not rank in the top 50 for google. Why is this? (I know there is a lot I could do to improve the SEO keywords on this site, but I am limited because of the client's budget.) However, if I could just get a handle on the answers for these types of issues, I think I would feel much more confident as an SEO specialist. Right now I feel more like a fraud. =( Any insight into what may be causing this would be greatly appreciated! Thank you.
Moz Pro | | RuthWrites0
