"Does not respond to web requests" error
-
When trying to set up a new campaign I get the following message:
"Roger has detected a problem: We have detected that the domain www.chicagofinancialadvisers.com does not respond to web requests. Using this domain, we will be unable to crawl your site or present accurate SERP information."Can someone please tell me what I need to do on my site to make this work? I haven't seen this before and have done many other campaigns. Thanks a lot!
-
Thanks Ryan. That worked!
-
Hello Brien,
I noticed your robots.txt file currently shows as
**User-agent: ***
That is not a properly formatted robots.txt file. You need to add an additional line. Try adjusting as follows:
**User-agent: ***
** Disallow:**
This change MAY resolve the issue. If not, I would suggest checking your server firewall settings to discover if any ports or crawlers are blocked.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz and HubSpot SSL - crawl error?
I'm getting an error message when Moz tries to crawl my site, however when I check in Google Search Console, they return no errors. Our site is hosted on HubSpot. Is Moz still having trouble crawling HubSpot sites that have enabled their SSL? I read an article that this should have been corrected in early 2017, but I'm getting an error.
Moz Pro | | jennygriffin0 -
404 errors High Priority Issues in Moz Pro: change to 301 or not ?
Hi there, Moz Pro is showing us 404 errors on our site as High Priority Issues. These 404 errors regard deleted product pages, which we did not 301. Should we 301 them all backwards ? We have an ecommerce site. After reading How Should You Handle Expired Content? on Moz and a few other Q&A discussions I now know we should 301 each expired url and now we do so. My concern is with what was done in the past, and what we should do about it: for the past few years we have been leaving the pages on the site, creating a big amount of outdated url's without either content nor traffic in march our IT decided to delete these url's, and ask for a webpage removal in Google Search Console: we 301 only a 40 url's and 404 the other 3500 now 6 monthts after, we still have 2500 crawl errors in the Search Console, and Moz Pro finding each week new 404 errors Our SEO consultant says we should not bother about the errors shown in the Search Console. But I am concerned about these errors not reducing, and about Moz Pro High Priority Issues: should we 301 the url's to similar categories or products?
Moz Pro | | isabelledylag0 -
How Old or How Often does the "Beginners Guide to SEO" Get Updated
Good morning 🙂 Just wondering how often does the intro/beginners guide get updated? I often refer back to this guide for some "back to basics" Regards George
Moz Pro | | Giorgio680 -
How to fix the Crawl Diagnostics error and warnings
hi im new to the seo world and i dont know a lot about it , so after my site get crawled i found 1 error and 151 warning and 96 notices , it that bad ?? and plz cam someone explain to me how to fix thos problem , a will be very thankful
Moz Pro | | medlife0 -
Is there a way to get SEOMOZ to not throw an error if i'm using the rel=canonical tag?
There are so many errors (~1500) that I can't find the pages with duplicate content among the ones that are correctly tagged
Moz Pro | | seospeedwagon0 -
Is it normal to see the "Loading a sweet graph" message for more than 10 minutesd?
Hi! I'm on the Rankings History page, and for more than ten minutes I have seen this message where I should see data on organic visits: Organic Google traffic for visitors from United States Loading your graph data. Thank you for your patience… Loading a sweet graph... Is this normal? Could there be something wrong with my Google Analytics connection? Thanks! P.S. I looked up "loading a sweet graph" in this forum before posting, but didn't find anything.
Moz Pro | | ScottShrum0 -
Getting Redirect Loop and Oauth Error When Adding Facebook Page
Hi all, I keep getting the following error when trying to add my Facebook page. It worked fine in the past and has suddenly stopped working: The webpage at https://graph.facebook.com/oauth/authorize?client_id=142287725855094&redirect_uri=http%3A%2F%2Fpro.seomoz.org%2Fcampaigns%2F173488%2Fsocial%2Fcreate%2Ffacebook%2F127833296954.html&scope=read_stream%2Cuser_videos%2Cuser_photos%2Cuser_photo_video_tags%2Cmanage_pages%2Cread_insights has resulted in too many redirects. Clearing your cookies for this site or allowing third-party cookies may fix the problem. If not, it is possibly a server configuration issue and not a problem with your computer. I've tried clearing cache and deleting cookies. Any other ideas I would try? Thanks!
Moz Pro | | kenc1380 -
Where do I find "URLs Receiving Entrances Via Search" and "Non-Paid Keywords Sending Search Visits" in Google Analytics?
These are two metrics highlighted in the "Organic Traffic Data" report in the PRO campaigns. Since this report is composed of data linked from Google Analytics, I bet there's a way to find this same information in GA. So...anyone know how to do that in Google Analytics? I want this information for some long-tail productivity/potential research.
Moz Pro | | jcolman0