Need to solve "Oops our crawlers were unable to access" url for new campaign
-
I'm putting the url designfirstkitchenandbath.com and getting the "oops! our crawlers were unable to access the site. Since this site is a potential client, which shows up online, I can't get access to fix the code, plus while I can write a little html I don't feel comfortable working with hard, live code on someonelse's site. Anyone have a simple solution?
-
Hey there!
Sam from Moz's Help Team here!
I've taken a look at that URL, and from what I can see it looks like we're running into a 403 error which means that ultimately, access to that URL is forbidden:
http://www.screencast.com/t/UbMwIrjuQFG
This 403 error is coming directly from your server, so at this point the best thing to do will be to send this information to your client/their web dev. They'll need to make sure our crawler (rogerbot) is whitelisted, so our tools can start working hard for you, and that you aren't blocking AWS (Amazon Web Services) on the server level.
I hope this helps - if you have any other questions, feel free to pop a message over to help@moz.com
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved New Moz Bar not working in my domain
Hello, I have installed the new version of Moz Bar in Google Chrome.
Moz Bar | | Alberto D.
My problem is that it analyzes all domains except mine: https://elchesemueve.com
I also can't find my country (Spain) to configure the site.0 -
Tracked Ranking Keywords in Campaign and Ranking Keywords in Keyword Explorer are coming up with very different results - does anybody know why?
We have a campaign set up that is tracking keywords with varying monthly volumes and the website is ranking for them. I have gone into the new Keyword Explorer Feature (looks great!) and I have tested it by putting in the root domain address mentioned above. My problem is that none of the keywords that I am tracking and ranking for are appearing in the "ranking keywords" report in Keyword Explorer. Does anybody know why this might be happening?
Moz Bar | | RedAntSolutions0 -
Error 406 with crawler test
hi to all. I have a big problem with the crawler of moz on this website: www.edilflagiello.it. On july with the old version i have no problem and the crawler give me a csv report with all the url but after we changed the new magento theme and restyled the old version, each time i use the crawler, i receive a csv file with this error: "error 406" Can you help me to understan wich is the problem? I already have disabled .htacces and robots.txt but nothing. Website is working well, i have used also screaming frog as well.
Moz Bar | | ArchieDonnithorne1 -
Change an "Answered" question to "unanswered?"
Some times Moz marks my questions as 'answered" when they are not. I know that if I mark something as a "good answer" or select "answered" (obviously) it will change, but occasionally (like the last question I asked) it gets changed and I'm not sure how to change it back to "unanswered." Anyone know if that's possible? Thanks, Ruben
Moz Bar | | KempRugeLawGroup1 -
How to find all 301 redirect for URL xyz.com/products (internal and external)?
This is what we are thinking: Get all URL of the xyz.com/products using XENU software. Search those URL on google (site;xyz.com url ) to find out if they are crawled by google, do the same on bing (as currently google shows 4k URL and bing 11k ) Use opensiteexplorer (301 redirect ) and using (internal external) to get the desired result. Is this the right approach? If not, what is the best way to find the correct result? All suggestions are welcome.
Moz Bar | | tpt.com0 -
Probs with campaign overview page ??
Hi As of today my overview pages are devoid of formatting and just text and basic display, anyone else getting this ? Cheers Dan
Moz Bar | | Dan-Lawrence1 -
Moz "Crawl Diagnostics" doesn't respect robots.txt
Hello, I've just had a new website crawled by the Moz bot. It's come back with thousands of errors saying things like: Duplicate content Overly dynamic URLs Duplicate Page Titles The duplicate content & URLs it's found are all blocked in the robots.txt so why am I seeing these errors?
Moz Bar | | Vitalized
Here's an example of some of the robots.txt that blocks things like dynamic URLs and directories (which Moz bot ignored): Disallow: /?mode=
Disallow: /?limit=
Disallow: /?dir=
Disallow: /?p=*&
Disallow: /?SID=
Disallow: /reviews/
Disallow: /home/ Many thanks for any info on this issue.0 -
Ranking report in Pro Campaign Not Accurate?
I have been running ranking reports on my pro seomoz account for a couple of years now. I recently added a lot more keywords to my list. Unfortunately there now seems to be a problem. It shows that many of my keywords have dropped out of (and climbed in) the top 50 when they actually haven't. I think it's just missing the keyword out and assuming that it dropped. I'd prefer it said "Not checked". Anyone else with a similar problem? or ideally a solution at my end... Thanks all!
Moz Bar | | trickshotric0