Onpage grader says site unreachable
-
It is possible the crawler is caught in the firewall. Any idea what I need to have whitelisted?
-
Thanks for the update! So glad it's working now.
-
Just to update for people that see this question in the future. The problem was caused by the lack of intermediate certificate. Everything is now working.
-
Just to add, I managed to run a site crawl (the one with the downloadable csv file) so clearly it is just related to the on-page grader.
Also, rather strangely other sites on the VPS work fine (http).
Therefore I am thinking more and more that it is an SSL intermediate certificate issue.
-
Yeh, that answer was not very helpful, although it contained useful information.
My working theory is that as I just transferred the site to one of my VPS that the SSL doesn't have a valid intermediate certificate. I will have a closer look at resolving this tomorrow.
It probably didn't help that I was not accurate with the error message which states that "sorry but that url is inaccessable".
-
Have you considered going through your server and/or firewall logs to find out the root cause of the issue? Your host should be able to help you there, even without any IP's. Just run a crawl, and tell them approximately what time you ran it - that should be enough for them to start analyzing the issue.
The first question to find an answer to is what is blocking the crawler, followed by how is it blocking the crawler and finally, why is it blocking the crawler.
Once you find an answer to those questions, it will be vastly easier to help you find a solution.
-
Well, my host cannot check without IP's and from what I read Moz doesn't give out IPs as they are dynamic.
I guess that leaves me stuck unable to use this service.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site crawl warning - concatenated urls from Wordpress
I could use some help on how to fix this. I asked at the walkthrough but was told it was a Wordpress issue but so far I can't find anything to point me in the right direction. There are no errors in the files on server side and I have asked my hosting company too. I am hoping someone here may be able to shed some light on it. One of my websites it giving 404 errors on links that are formed as below and there are over 12.7K of them! Example: <mydomainurl>/www.instagram.com/www.instagram.com/<instagram username=""></instagram></mydomainurl> The link that relates to my website is valid and working, but I don't understand the rest. I am totally stumped on how to move forward with this. Any advice, suggestions, tips on how to fix these errors and stop these types of links getting generated. Thanks.
Moz Bar | | emercarr0 -
Why do I have so many site crawl issues with my site?
Hi there, Our website is www.mormonhub.com. We have many other websites that we own as well. For some reason, our website has tens of thousands of Site Crawl Issues. We have tried looking into what's causing the problem, but can't figure it out. We do use Wordpress for our website. Any help would be greatly appreciated. Thanks! wFL8I
Moz Bar | | ThridHour0 -
Onpage Grader not Finding Keyword in URL
I've noticed that the Onpage Grader is not including my keyword in the URL when the keyword is in the domain. If I grade an inner page and the keyword is in the sub-directory, it finds it. Is this intentional? If so, why does the grader not include my keyword in the domain as Keyword in the URL?
Moz Bar | | Dino640 -
Getting 'Sorry, but that URL is inaccessible' error msg when trying to run On-Page Grader
I just signed up for MOZ Pro for the first time today. Tried to run the 'on-page grader' tool on some of my pages but I'm getting a 'Sorry, but that URL is inaccessible' error msg. I have verified against the robot.txt file that the pages are NOT blocking any crawlers. Can anybody help?
Moz Bar | | spinoki0 -
We Launched a new site and Rogerbot is still reporting on links/errors from the old site, is there a way to clear those out?
We are mostly a Branding agency, and have not put a lot of effort into SEO for ourselves... SEO tends to take a backseat to design most of the time, making it a little difficult for me at times when it comes to SEO. We recently launched a new site, http://Roninadv.com/ and the developer and I have done quite a bit of work to make it work well for Google. I was really looking forward to a new crawl report from Roger, but alas, It's like Roger crawled the old site? The new site has been up since last Monday. Is there a way to clear out the old errors? Do I just need to give roger more time?
Moz Bar | | PaulRonin0 -
Where is the old seomoz.org onpage analyzer?
I am just getting back to Moz following an update. Before seomoz.org became moz.com. there used to be a tool that did some onpage analysis that I can't seem to find anymore (searched all day). It did things like: Duplicate Title Duplicate content Broken links etc... Would someone please be so kind as to provide me the link to this tool? Or if it is no longer available, a 3rd party tool? Kind regards, Kurt
Moz Bar | | Kurtyj0 -
Keyword Grader & OmniExplorer_Bot Question
I found this in several of my clients Robots.txt "User-Agent: OmniExplorer_Bot Disallow: /" Right now I cannot grade any of them that are on a particular platform that has that written in. Would this block the keyword grader? Thanks!
Moz Bar | | OOMDODigital0