Need to solve "Oops our crawlers were unable to access" url for new campaign
-
I'm putting the url designfirstkitchenandbath.com and getting the "oops! our crawlers were unable to access the site. Since this site is a potential client, which shows up online, I can't get access to fix the code, plus while I can write a little html I don't feel comfortable working with hard, live code on someonelse's site. Anyone have a simple solution?
-
Hey there!
Sam from Moz's Help Team here!
I've taken a look at that URL, and from what I can see it looks like we're running into a 403 error which means that ultimately, access to that URL is forbidden:
http://www.screencast.com/t/UbMwIrjuQFG
This 403 error is coming directly from your server, so at this point the best thing to do will be to send this information to your client/their web dev. They'll need to make sure our crawler (rogerbot) is whitelisted, so our tools can start working hard for you, and that you aren't blocking AWS (Amazon Web Services) on the server level.
I hope this helps - if you have any other questions, feel free to pop a message over to help@moz.com
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved New Moz Bar not working in my domain
Hello, I have installed the new version of Moz Bar in Google Chrome.
Moz Bar | | Alberto D.
My problem is that it analyzes all domains except mine: https://elchesemueve.com
I also can't find my country (Spain) to configure the site.0 -
Page Grader states "includes Canonical Tag" but it's not in the page source at all
I've ran it multiple times and changed other things it picked up on so not sure where it's getting the canonical tag is included even though it isn't?
Moz Bar | | Wana-Ryd0 -
Why isn't the Moz crawler getting all of my item pages?
I am stumped and Moz is being terrible to work with. This site has about 40k pages 39,800 of them are item pages roughly. Moz is only finding about 2400 of my pages. So they are missing most but not all of my item pages. I do not know which item pages they are missing. The fact that they are finding about 2k but not the rest leads me to believe the crawler is struggling with pagination. The site is built on Magento 2 and uses the Amasty Layered Navigation extension. Does anyone have any ideas?
Moz Bar | | Tylerj0 -
Why doesn't the Keyword Explorer "Explore By Site" work?
Whatever page/domain url I put in here, I get a message coming up saying ""Getting rankings counts failed" Why does his happen? I can't find anything in the Help about this.
Moz Bar | | mfrgolfgti0 -
Is there a way to export all your crawl errors for multiple Moz campaigns at once?
We're looking for a simple way to export all crawl errors for our Moz campaigns. More than likely we could use the API, but was wondering if there was any functionality already built into Moz for exporting all crawl errors.
Moz Bar | | ReunionMarketing0 -
We Launched a new site and Rogerbot is still reporting on links/errors from the old site, is there a way to clear those out?
We are mostly a Branding agency, and have not put a lot of effort into SEO for ourselves... SEO tends to take a backseat to design most of the time, making it a little difficult for me at times when it comes to SEO. We recently launched a new site, http://Roninadv.com/ and the developer and I have done quite a bit of work to make it work well for Google. I was really looking forward to a new crawl report from Roger, but alas, It's like Roger crawled the old site? The new site has been up since last Monday. Is there a way to clear out the old errors? Do I just need to give roger more time?
Moz Bar | | PaulRonin0 -
New website launched 3 weeks ago but not sure what Moz Analysis is telling me?
Hi 3 weeks ago I re-branded and completely changed the proposition on www.over50choices.co.uk as the URL is appropriate to the proposition. And whilst it looks good I am unsure what the Moz Tools are telling me, other than it doesnt look good? There should be about 163 pages, but Moz reports over 500 due to i think so many 301's? Plus most pages under the HTTP Status reports No Data! Most of the the 404's are from the old site. Webmaster Tools say 163 pages submitted but only 2 indexed, but on site:search it says about 117 but 40+ of these are the old site. It looks a mess...! Sleepless nights have started - any thoughts!? Thanks Ash
Moz Bar | | AshShep10
