'Domain Does Not Respond To Web Requests'
-
Hi everyone,
This seems to be a fairly common query on the Q&A section, but I haven't been able to find a solution by reading through previous threads.
When I try to set up an SEOmoz campaign for spryz.co.nz, I get that ol' favourite error message:
'We have detected that the domain spryz.co.nz does not respond to web requests. Using this domain, we will be unable to crawl your site or present accurate SERP information.'
The problem isn't being caused by a Robots.txt file, and the site has experienced 99% uptime since it was launched.Traffic stats show that visits are coming through to the site via the search engines, suggesting that it may not be all crawlers that fail to access the site.
I've tried to set up this campaign several times throughout the day, since I've read that sometimes Roger goes on the blink, but I've still not been successful.
Any suggestions as to why Roger might be unable to crawl my website would be great.
-
Having the same issue - would prefer not to post the domain name though. It's my first time using SEOMoz, new PRO user, and I'm literally blocked from my first campaign. The site is responsive, hosted on a great server, there's a robots.txt that's intact and is only disallowing access to one particular directory, and the site is currently indexed in Google because I can see the pages.
Methinks there's something wrong on your end - this question has 120 views which means it's more than a few isolated cases. Should I just go ahead and set up the campaign anyway, ignoring the error?
-
Hi there,
Thanks for reaching out! That is interesting indeed that you aren't able to create a campaign for that particular domain. I do notice that I had trouble at first, but I tried again immediately and was able to go past the no response screen and create a campaign. http://screencast.com/t/H2apiZb0tvB. I have checked with our team and we are not seeing an issue with the crawler so far, however in the past our crawler have had trouble with pages that is missing a Robots.txt (404 when I checked it last) http://screencast.com/t/oacVSiHM3Nyf. However as I have shown, our crawler will now crawl sites in the absence of a robot.txt.
There's a few reason why it could be not responding to our web request:
1. The uptime was sporadic when we made the attempt.
2. Something on the server level is blocking our web service, which is provided by Amazon.Unfortunately the problem is too sporadic, I will start a ticket for you on my end and let's see how my campaign comes back before we decide anything. Hope that helps!
Best,
Peter SEOmoz Help Team.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Using the free domain analysis tool - what would cause "Bummer no data found"
When I enter my domain in the free analysis tool, I get a "bummer, no data found". I am certain whatever is causing that to happen is causing other SEO problems https://academicanv.org
Getting Started | | verdet32323 -
Can I view Domain Authority stats for longer than the previous 12 months?
When you view the DA chart, it goes back 12 months. There is no apparent way to see any data before that. I searched the Q&A but see no other similar questions. Any insight?
Getting Started | | cptutty0 -
Where does SEOMoz pull it's keyword data from?
I would like to know where the data in the keyword recommendation tool comes from. Specifically, from what sources is SEOMoz referencing to compile the keyword recommendations and analysis? Thanks!
Getting Started | | FilterEasy1 -
I set up a custom report to be sent to me daily about a week ago, but I haven't received any of them yet?
How long do they really take? I think I opted in to receive emails from MOZ but I didn't see that as an option on the email form. I need to be able to rely on the assumption that if I set up a custom email to send that it will in fact send.
Getting Started | | matthew.dimmett0 -
Custom report doesn't list keywords.
I'd like a report which shows a list of all the keywords and their ranks - s it possible to get a complete list in the report rather than just summary of rankings?
Getting Started | | ukandyh0 -
Can't create a brand query?
When I try to create a brand query, clicking the 'preview query' button doesn't do anything. Anyone else have this happening to them? It would be my first brand query if that matters.
Getting Started | | pixelflyte20140 -
Can't setup new campaign
Hi everyone, I'm trying to set up a new campaign for a website which has Cloudflare installed. After I enter the campaign name and URL the loading circle comes up and spins for a while, but then it just stays on the same page. No error message is given. I can't get to the next page of the setup campaign form sequence so that I can set up this campaign. Has anyone else had this problem and is there any fix? Thanks in advance
Getting Started | | _jrmo
James0 -
Oops! This doesn't appear to be a valid URL. Please try again.
Hi, I just started with using MOZ and at my first attemp I can not start a new campaign because my url doesn't appear to be valid.. I tried http://www.mydomain.nl , www.mydomain.nl and mydomain.nl.. It's a Dutch extension (.nl). Can this be the problem? Excuse me my spelling and typo's. I'm Dutch 🙂
Getting Started | | SWP0