SEOMoz site crawlers created an issue for our servers
-
I have set up a number of campaigns with your pro tool. Unfortunately we have 7 sites on our server and our IT dept have said that we had an issue when your site crawlers visited for several sites at the same time - is there any way that I can retain the campaigns but have the sites crawled on request rather than automatically?
-
Hi Stephen,
If your server can't handle the SEOMoz spider, it wouldn't probably survive to all the malicious spiders out there... You should realy think into getting a new hosting account/server (or a new IT dept...).
In the "Campaign Settings" you have a "Weekly crawl completed _for campaign: _" checkbox that you could uncheck to disable the crawling of a certain campaign.
You might also want to use the "Crawl-delay:" directive into your robots.txt file, I don't know if it is supported by SEOMoz spider, but it might protect your server from other spiders.
Otherwise, like Barry Smith suggested, you should get in touch with SEOMoz team and see what they can do. If their crawler doesn't support the "Crawl-delay:" directive, you might want to suggest them to implement it.
Best regards,
Guillaume Voyer. -
Best to get in touch with them directly - http://www.seomoz.org/about/contact
customerservice@seomoz.org should get your email to the right people (as I don't know who best to contact about tools)
Alternatively you could use the helpdesk - http://seomoz.zendesk.com/home
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEOMoz Q&A having some issues?
Apologies if this has been asked. I was browsing Q&A and got a Ruby error page, reloaded and everything was fine. However a bunch of the topics are kind of messed up, and it looks like a chunk of them are missing now. For example my 'questions I've answered' section of My Q&A only has the newest question and the oldest question, and when I sort the SEOMoz Tools category by newest I get one recent post and then the next one is from November of last year. You guys having database problems?
Moz Pro | | icecarats0 -
Recent SEOMoz Crawl = Strange Results
Did anyone else get some really strange results in their weekly crawls this week with the campaign tool? Either my ranks sky rocked across three different sites or the tools is busted. Something to the tune of having 4 pages ranking in the top 30 to now having 15-16 pages ranking in the top 30. I'd love to find out it is just all the hard work paying off but i am worried it is the later. Regards - Kyle
Moz Pro | | kchandler0 -
Why did SEOMoz only crawl 1 page?
I have multiple campaigns and on a few of them SEOMoz has only crawled one page. I think this may have to do with how I set up the campaign. How do I get SEOMoz to crawl more than one page on these campaigns.
Moz Pro | | HermanAdvertising0 -
Is there any alternatives to Yahoo Site Explorer?
Hi, Is there any alternatives to Yahoo Site Explorer? I want to find backlinks of some unavailable pages and YSE was a great tool to deal with. But when I used tools like Open Site Explorer, ahrefs.com etc., I couldn't find one same like YSE. Because when I tried, it shows'No data available for this URL' where on YSE I found inbound links. What Alternatives Are There? thanks in advance!
Moz Pro | | VipinLouka780 -
Site metric tool
Is there a tool on here (or anywhere else) where you can upload a list of sites (say 500 sites) and be given things like mozrank on it?
Moz Pro | | thefresh0 -
Multi-languae site anda Campaigns
Hi, I need to optimize a multi-language site. It's an hotel chain website and has 4 languages. Each language version of the site must be optimize for a diferente Google Engine. The english version of the web must be optimized for Google United States, an so on. Do I need to create a new Campaign for each language? or can I use more than 4 Engines in one campaign. Thanks,
Moz Pro | | Dragut-Comunicacion0