Campaign Not Crawling
-
I set up my first 5 campaigns and one is not crawling beyond one-page. It's been over 48 hours.
This site has nearly 3.500 pages the others much less, however, this shouldn't make any difference.
I searched for the problem and couldn't find it so I hope this question isn't redundant.
Comments and advice would be appreciated.
-
OOHH-LA-LA
That pesky Amazon cloud. Maybe a big Bingo. I will remove the blocked IPs from Amazon hosting. I had someone from those IPs slamming Google Ads so I blocked a big range all related to Amazon.
If the problem exists I'll reconstitute the block but for now let's see if removing them helps.
OK - I removed the motherload of IPs and I will come back and respond to the result after about 48 hours or sooner if I see positive results.
UPDATE: After removing the blocked IPs the site was crawled the max 10K pages.
UPDATE 2: The Adsense slammer returned under several different Amazon Cloud IPs so I had to block the full range again as I don't want to get banned by Google. No money registered only numerous ad clicks. This is unacceptable so I won't crawl this site.
Thanks,
Don
-
Hi Don,
So sorry to hear about the problems. Check out this help topic addressing what to do when only one page is crawled. If that doesn't solve your problem, send an email to help@seomoz.org
http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page
-
Ah, ok, sorry - I misread your question Don.
I think I had the same problem with a campaign for a while, luckily it wasn't urgent so I left it, but it took a while to sort itself out
-
Hi Shelly:
The other 4 campaigns look to have gone through that starter crawl just fine, ergo, my question about that 5th campaign. I suppose if I don't see any action in a couple of more days I will indeed direct a question to the SEOMoz team but will leave this question open for a while also.
Thanks.
-
As I understand it, it takes a week for a complete crawl to be carried out on any new campaigns, but you now get a starter crawl when setting up a campaign - the starter crawl isn't as comprehensive and may explain why your sites haven't been crawled properly yet.
It may be worth directing a request to the SEOMoz team via the help function
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can I add another user to my SEOMoz Pro campaign?
I have a couple of campaigns on my SEOMoz Pro account and I would like to give access of one of theses campaigns to a SEO consultant, is that possible? Or do I need to give access to my full SEOMoz account?
Moz Pro | | bernardovailati3 -
How to force SeoMoz to re-crawl my website?
Hi, I have done a lot of changes on my website to comply with SeoMoz advices, now I would like to see if I have better feedback from the tool, how can I force it to re-crawl a specific campaign? (waiting another week is too long :-))
Moz Pro | | oumma0 -
Can Google see all the pages that an seomoz crawl picks up?
Hi there My client's site is showing around 90 pages indexed in Google. The seomoz crawl is returning 1934 pages. Many of the pages in the crawl are duplicates, but there are also pages which are behind the user login. Is it theoretically correct to say that if a seomoz crawl finds all the pages, then Google has the potential to as well, even if they choose not to index? Or would Google not see the pages behind the login? And how come seomoz can see the pages? Many thanks in anticipation! Wendy
Moz Pro | | Chammy0 -
Adjusting SEOmoz Crawling Speed
How do you adjust the SEOmoz crawling speed? SEOmoz tried to crawl 10,000 pages in 3 hours and crashed our MySQL server.
Moz Pro | | cappuccino891 -
20000 site errors and 10000 pages crawled.
I have recently built an e-commerce website for the company I work at. Its built on opencart. Say for example we have a chair for sale. The url will be: www.domain.com/best-offers/cool-chair Thats fine, seomoz is crawling them all fine and reporting any errors under them url great. On each product listing we have several options and zoom options (allows the user to zoom in to the image to get a more detailed look). When a different zoom type is selected it adds on to the url, so for example: www.domain.com/best-offers/cool-chair?zoom=1 and there are 3 different zoom types. So effectively its taking for urls as different when in fact they are all one url. and Seomoz has interpreted it this way, and crawled 10000 pages(it thinks exist because of this) and thrown up 20000 errors. Does anyone have any idea how to solve this?
Moz Pro | | CompleteOffice0 -
Why is the SEOmoz crawler crawling the old version of our website?
Hello, I'm a new SEOmoz member. On Dec. 2nd, after completely redesigning our website, we migrated to a new hosting company by switching our DNS to the new server. The vast majority of the URLs have changed and we configured redirects of the old URLs to the new ones. Although, this task is not completed yet. After the migration, I created an account on SEOmoz to be able to track our progress and find the issues to fix to optimize our SEO. For some reason, in the SEOmoz reports it is the old URLs that show up. Unless the crawler does not actually crawl the pages and only uses the indexed pages to generate its report, I don't understand how could this possible. Anyone has a clue? When will the new URLs be indexed by SEOmoz and the major search engines? Thanks for your help!
Moz Pro | | Gestisoft-Qc0 -
SEOmoz PRO campaign fot HTTPS site
Hi all, I'm trying to configure a PRO campagin for a https website. Butt it won't work. The software says it found a one redirect (for http to https I guess), and that's it. So now I don't have any data.... Can anybody help me? Thnx! Martijn
Moz Pro | | Men4Media0 -
Errors on my Crawl Diagnostics
I have 51 errors on my Crawl Diagnostics tool.46 are 4xx Client Error.Those 4xx errors are links to products (or categories) that we are not selling them any more so there are inactive on the website but Google still have the links. How can I tell Google not to index them?. Can those errors (and warnings) could be harming my rankings (they went down from position 1 to 4 for the most important keywords) thanks,
Moz Pro | | cardif0