Need to solve "Oops our crawlers were unable to access" url for new campaign
-
I'm putting the url designfirstkitchenandbath.com and getting the "oops! our crawlers were unable to access the site. Since this site is a potential client, which shows up online, I can't get access to fix the code, plus while I can write a little html I don't feel comfortable working with hard, live code on someonelse's site. Anyone have a simple solution?
-
Hey there!
Sam from Moz's Help Team here!
I've taken a look at that URL, and from what I can see it looks like we're running into a 403 error which means that ultimately, access to that URL is forbidden:
http://www.screencast.com/t/UbMwIrjuQFG
This 403 error is coming directly from your server, so at this point the best thing to do will be to send this information to your client/their web dev. They'll need to make sure our crawler (rogerbot) is whitelisted, so our tools can start working hard for you, and that you aren't blocking AWS (Amazon Web Services) on the server level.
I hope this helps - if you have any other questions, feel free to pop a message over to help@moz.com
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
"New" issues not previously found being shown?
I'm not sure what logic Moz is using for its reporting of Site Crawl issues, but it appears to be pretty flawed (unless I'm missing something, which is possible). I've got a client site that has been in Moz for about 6 months now. Every time the crawler runs, the same number of pages are reported as having been crawled. However I'm consistently getting "New Issues" reported that should have been reported during previous crawls. Example: A redirect chain was reported several month ago. The referring URL was the homepage of the website, and we tracked it down to an old link in the header. This was fixed, marked as resolved, and the issue was not shown on the next crawl. Several weeks later, the same issue was reported for a different page on the website - a page which has existed since 2014 and was already crawled many times. Again, we fixed. Fast-forward to the report that just ran on 12/1 and we have the same issue reported, for a different page, which has also existed for years and has been previously crawled. It's very hard to explain to a client "this item you are seeing has been resolved", only to have it continually crop back up in future reports. Note this is not limited to redirect chains - that's just an example. I'm seeing this for other items such as missing canonicals, duplicate titles, etc.
Moz Bar | | RucksackDigital0 -
Not sure where this url has come from
can anyone please let me know why this has happened on my site. I have just done a crawl test and it comes back with the following <colgroup><col width="576"></colgroup>
Moz Bar | | in2townpublicrelations
| http://howtodrinkless.com/web/20150709201150/http:/www.howtodrinkless.com/ |0 -
After adding a new page to optimization section it shows up as dashes
After adding a page to the optimization section, it doesn't put the score, title, or ranking on. It shows up as dashes After adding a new page to the optimization section it shows me my score. I go back to the home page of the optimization section to see it's ranking and all the details are dashes. Like the moz score, the ranking, and the title. It has only been happening recently. What am I doing wrong?
Moz Bar | | leannegoff0 -
"WWW." versus Non - "www."
Our web developer recently changed our preferred domain from "www.thinkbiglearnsmart.com" to "thinkbiglearnsmart.com" so when I check the authority of the "www." it is higher than the "thinkbiglearnsmart.com." do you have any insight onto if we should just make our preferred URL "www." because that's how it was for years? Is there a way just to merge the two back together so it is not sort of having different information for the same site? Thank you!
Moz Bar | | thinkbiglearnsmart0 -
No Keyword in URL, but it is there
Hi,friends. I have grade A on all pages but system shows like no keyword in url, but it is there. for example i have Latvian keyword: bīstamo kravu pārvadājumi (with Latvian characters like Ū, Ā) I have url with exact keyword in it: http://vervo.lv/lv/kravu-parvadajumi/transports/bistamo-kravu-parvadajumi So why moz dont see that keyword, it does not understand special characters?
Moz Bar | | Liva0 -
New moz analytics...will it have reporting?
Loving the new Moz Analytics...very shiny. Just wondering if it will have reporting tied to it at some point? Thanks..Jeannie x.
Moz Bar | | Jeannie.0 -
Best way to submit multiple, simultaneous urls to SEOMOZ
I have a pro membership, and am looking to get inbound link data on multiple urls. Is there a way to submit multiple urls at once?
Moz Bar | | cmcilwain0 -
Path of Moz Crawler Report?
Hi, I'm finding path of moz crawler report. Please tell me where I can find this tool?. Thanks
Moz Bar | | KLLC0