SEOMoz site crawlers created an issue for our servers
-
I have set up a number of campaigns with your pro tool. Unfortunately we have 7 sites on our server and our IT dept have said that we had an issue when your site crawlers visited for several sites at the same time - is there any way that I can retain the campaigns but have the sites crawled on request rather than automatically?
-
Hi Stephen,
If your server can't handle the SEOMoz spider, it wouldn't probably survive to all the malicious spiders out there... You should realy think into getting a new hosting account/server (or a new IT dept...).
In the "Campaign Settings" you have a "Weekly crawl completed _for campaign: _" checkbox that you could uncheck to disable the crawling of a certain campaign.
You might also want to use the "Crawl-delay:" directive into your robots.txt file, I don't know if it is supported by SEOMoz spider, but it might protect your server from other spiders.
Otherwise, like Barry Smith suggested, you should get in touch with SEOMoz team and see what they can do. If their crawler doesn't support the "Crawl-delay:" directive, you might want to suggest them to implement it.
Best regards,
Guillaume Voyer. -
Best to get in touch with them directly - http://www.seomoz.org/about/contact
customerservice@seomoz.org should get your email to the right people (as I don't know who best to contact about tools)
Alternatively you could use the helpdesk - http://seomoz.zendesk.com/home
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Using seomoz.
Hi, I'm scouring the web for new links, and am taking a closer look at OSE; I'm trying to gauge whether the PA & DA rating(s) in the results page for a domain search takes into account any penalty signals the site may be showing, and whether there is a 'real' way to identify how much value links from the source will give you (if for example, there's already x10 other links away from that page or x100 links away from that domain). Basically - what else needs to be taken into account when using this app to identify link sources, etc. Thanks, David
Moz Pro | | newstd1000 -
Google Analytic Caching Issue?
Two weeks ago, I started testing a campaign and linked it to my Google analytics account. At the time there were 4 domains linked to the GA account. And I could see all 4 domains at the drop down menu that asked me to choose one to connect to. One week ago, I added a 5 more domains to GA. When I log directly into GA, I see the total of all 9 domains, and all are verified and collecting data. Today at pro seomoz I started a new campaign, for one of the new domains recently added to GA. When I try to connect the campaign to GA, only the ORIGINAL 4 domains are visible on the drop down menu. None of the 5 new domains are visible. So I am unable to connect to the new domain. At campaign settings, I disconnected from GA, and connected again, but could not see the new domains on the drop down menu. I tried to use both FF and IE. I can only assume that this is a caching issue at pro.seomoz. If so, how to flush cache and get current again. Please advise
Moz Pro | | microonae0 -
Why did SEOMoz only crawl 1 page?
I have multiple campaigns and on a few of them SEOMoz has only crawled one page. I think this may have to do with how I set up the campaign. How do I get SEOMoz to crawl more than one page on these campaigns.
Moz Pro | | HermanAdvertising0 -
Why does Open Site Explorer show less inbound links than yahoo site Explorer?
Hello, We have a question regarding inbound link measurement. We used to measure our inbound links with yahoo site explorer. Now that it's been shut down we use opensiteexplorer.org. However, Open Site Explorer only shows a fraction of inbound links compared to yahoo site explorer. For our website www.theprintspace.co.uk yahoo site explorer measured approx. 14,000 inbound links, whereas open Site Explorer only counts approx. 3,000. This is more than 10,000 links less. For our other website www.theprintspace.de Open Site Explorer also shows 3000 links less than Yahoo. How can this be? Does Open Site Explorer count the links in a different way to Yahoo? Please explain. It would be great if you could help us with this. Thank you!
Moz Pro | | Waplington0 -
Opensite explorer issues still there
Hi I asked a question a few weeks ago regarding the linkings being shown in opensite explorer showing crazy stuff like psds and odd file formats as being the source of the links. I was told it was being repaired , the results were almost useless and I stopped using , I have just logged back in to check again and see even more random odd results with sites that would have no reason to link to us. Is this tool ever going to be repaired ? Is there a ETA for the fix ? How come you are launching new tools when the existing ones dont work ? Kind Regards
Moz Pro | | jbloggs0 -
Site not showing data in Open Site Explorer
I have run open site explorer for a couple of sites but I am getting the "no data available for this URL" message. I have read the reasons listed on the error message but none of these apply to the particular sites I am looking for data from. Any thoughts as to why this might be? Thanks, Kwan
Moz Pro | | SocialKwan0 -
How to set up SEOMOZ to track multilanguage sites?
Hi, I am managing a site in 5 different languages/regions. Our language structure is as follows: www.domain.com/en-us/ - For US www.domain.com/en-uk/ - For UK www.domain.com/fr/ - For France ... However, SEOMOZ does not allow to set up a domain with "/" as a campaign. How can I do it? Thanks
Moz Pro | | hockerty1 -
Do you have a testimonial for us? SEOmoz wants to hear them!
Hi everyone! Hope you don't mind me using Q&A to ask for your feedback, but we are looking for testimonials from PRO members on our tools, web app, and resources. These testimonials will be laced throughout the site on a variety of pages and will include -- your name, company, and possibly a photo {smile!} If you are willing to give one, please feel free to either email me -- joanna@seomoz.org, or leave in the comments below. We only need a line or two. Anything about what you think of our tools, how they have helped, etc., would be great! Thank you in advance, and I assure you this will not be a regular use of Q&A! We really appreciate your help and feedback everyone. #mozhug Joanna
Moz Pro | | JoannaLord2