Getting 'Sorry, but that URL is inaccessible' error msg when trying to run On-Page Grader
-
I just signed up for MOZ Pro for the first time today. Tried to run the 'on-page grader' tool on some of my pages but I'm getting a 'Sorry, but that URL is inaccessible' error msg. I have verified against the robot.txt file that the pages are NOT blocking any crawlers.
Can anybody help?
-
Thanks David. The alpha numeric digits are generated and appended to the page by the 'addthis', a third party sharing tool (http://www.addthis.com/).
Does this mean Moz will not be able to read all pages containing this redirect behavior?
-
Hi spinoki
For your URL there is a re-direct to http://www.healthpocket.com/medicare/california-medicare#.U9qw54BdXC8 which our tool cannot follow. It will need to resolve the URL without a re-direct.
-
Thanks David. I ran this URL (http://www.healthpocket.com/medicare/california-medicare) and received the following results:
HTTP 200 OK Content-type: text/html Date: Thu, 31 Jul 2014 20:43:16 GMT Set-cookie: connect.sid=s%3Ac4wchmmEPyGNLoni5bmAKsSa.bSsaR4%2Bufe3qdZ0dO3HoMtQB2VY5w3%2BHWLCqEkrBarc; Path=/; HttpOnly Vary: Accept-Encoding X-powered-by: Express Connection: Close
What should be my next steps?
-
Hello!
Outside of robots.txt most URL errors are a result of failed HTTP responses when running a standard curl check to the site. If you can provide me with the URL you are trying to add I can run a test or you can check what the response is through http://simonecarletti.com/tools/http-checker
Other times hosting providers block AWS (Amazon Web Services) IP addresses which we use to validated URLs from.
Re-direct loops will also prevent adding an URL, if you have a 302 or 301 to more than two URLs it will fail.
And any secure HTTPs sites will need all intermediate certificates on the web server to be a valid URL.
Hope this helps!
-
Sorry this took so long to get back to you.
To answer your question. As far as "server setting" etc, it really depends on what exactly needs to be changed.
Is it displaying a code? Is there a number associated with the error? Have you been able to identify which pages are having the problem?
I would look at this systematically. Now you may not have the time to do so, considering that this is work and not always play; I completely understand if your idea of a fun Friday night isn't sitting in your basement analyzing which pages are not working with the Moz site audit.
Regardless, let's find out where the errors are.
- Can you run other Moz tools on the pages that are causing the error?
- Does the side audit display any error for those pages?
- Are you copy and pasting the entire URL into the tool?
Another thing to keep in mind is that Moz did take a hit from a few DDoS attacks so I know a few of the tools have been iffy on and on. http://health.moz.com/ is a great spot to check and see if the tool you are looking for isn't working.
I think every SEO Tool (Majestic, Raven, SEM Rush, Search Metrics) really are giving you the same data just packaged & interpreted differently. They all have a specialty of course and that being said I have my preferences. Majestic will dig for more backlinks, SEM Rush will give the best Ad data, but realistically everybody is fishing from the same pond, granted it's a big pond. With an unlimited budget I would have 3 different programs for different things.
The amount of data that these programs are trying to interpret is awesomely massive. I don't know if any SEO tool is spot on, even Google Analytics for example. I think of them all, as a guide.
I started with Search Metrics which was incredible expensive and way to in-depth for my knowledge of SEO and my projects.
Later transitioned to Raven which was great because they pulled data from Majestic and Moz, and gave some great step by step suggestions. The problem was their spider couldn't run most of the websites I needed.
Lastly I ended up on Moz. A name I remember back when it was SEOMoz. Sure there are issues, but I found not only were the tools pretty on target, but the community was INCREDIBLY helpful. Which is one of the main reasons I have stayed. And I am a N3wb in comparison to most of the guys on here!
I'm sorry you're having a bad experience with the tool!
-
While some of the moz tools are inaccurate, most are a pretty good starting point for discovering errors. We have run into the same issue, where server settings were not allowing the rogerbot to access the page or pages.
-
Thank you. But 'server settings'? 'hosting providers'?! Isn't that a little complex consider that I've used other online seo tools and have never ran into this problem.
Also, if there are settings that I need to adjust before moz can have access of all of my pages, can I assume the other moz reports are incorrect?
thanks again.
-
I have a similar issue. I would look into the server settings or contact your hosting provider and ask them.
For us, our host (private hosting) is obsessive about cyber security and has the port flood settings adjusted so tightly that our website isn't able to be properly crawled by Rogerbot.
Another problem that I have run into before is if there are aspects of your website that are not fitting for Rogerbot. I would take a look at http://moz.com/help/guides/search-overview/crawl-diagnostics/rogerbot and see if there is something about your website that Roger doesn't like.
For example, the webmaster previous to me had 45 images in our slider..... yes.... 45 images.... and not only that but the slider was on every page of our website.... which was 600 pages... So finding a bot to crawl that was not easy. Once I was brought on, I removed 40 images and BAM roger was in! We still have some server based issues, but we have determined that it is on our end and are actively looking for a new host.
Hope that helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz bot has trouble crawling Angular JS - I believe it's seeing the SPA (Single Page Application) before Universal. Anyone else have this issue? What is the fix?
The Moz bot user agent detection settings are able to read Universal, but the Single Page Application (SPA) version partially loads on the website before Universal. Because of this, Moz (and possibly search engines) think we have massive duplicate content issues. For example, the crawl report said a particular product page (which has about 1,000 words) has 33,000 words and has duplicate content with over 300 other pages. This makes me believe it's only picking up the SPA version. Has anyone come across this, and what would be the fix?
Moz Bar | | laurengdicenso1 -
Page Optimization Error
Hi, I am trying to track a page optimization feature for one of my project, https://www.writemyessay247.com for keyword: write my essay but i keep getting this below error: "Page Optimization Error There was a problem loading this page. Please make sure the page is loading properly and that our user-agent, rogerbot, is not blocked from accessing this page." I checked robots.txt file, it all looks fine. Not sure what is the problem? Is it a problem with Moz or the website?
Moz Bar | | j.rahimi19900 -
Crawl report shows that it gets 4xx errors for pages that work fine. Why?
On the crawl report it has all these "Critical Crawler Issues". They all say "4xx Error", yet when i click on the link from the crawler report, it goes to a perfectly functioning page, not a 404 page or anything. If i click in it actually says it's a 403 error. It's all for pages generated by the IDX solution for our real estate website. Is Moz broken or am i missing something? Here are a couple examples: <dl class="crawl-page-details-list"> <dd class="crawl-page-details-list-emphasis">https://teamvivi.com/homes-for-sale-map-search/</dd> <dd class="crawl-page-details-list-emphasis"> <dl class="crawl-page-details-list"> <dd class="crawl-page-details-list-emphasis">https://teamvivi.com/email-alerts/</dd> </dl> </dd> </dl>
Moz Bar | | TeamViviRealEstate0 -
Moz tool bar shows "No markup schema" in webpage despites having proper schema code in page.
We have proper markup schema installed in webpage (validated using data structure tool by google) but moz tool bar says "Schema.org not found on this page." What should be the problem ?
Moz Bar | | NortonSupportSEO1 -
Crawl Test : Error attempting to request HTTPS page
Hallo When I launch the crawl report I get csv file with this error : 804 : HTTPS (SSL) error encountered when requesting page.
Moz Bar | | micvitale
Error attempting to request page; see title for details. Website is https://bastabollette.it0 -
How to increase Page Authority
Hi All, I have had some free time lately and have wanted to try and figure out how Moz calculates page authority and what I can do to increase page authority. For instance, I have a real estate site (As some of you may know already) and of course there are places like Zillow.com who have amazing Domain Authority and even page authority for a certain address. So this is just some random address to where most of the local sites I compete with have a PA of 1. Is there a way to get that PA up? Would it be sharing it on Social Media, or writing a blog post about it (which I of course would not want do do with every listing (hundreds) but was curious how Zillow could have such a high page rank on a property that maybe came up a day or two ago. Examples: zillow: http://goo.gl/99A57C my site: http://goo.gl/K6xmW6 Thanks for any guidance!
Moz Bar | | Veebs0 -
Learn how to build links using Fresh Web Explorer: Get your Daily SEO Fix!
This is our second video tutorial for The Moz Daily SEO Fix--tips and tricks with Moz tools in two minutes or less. In today's fix, Michael shows you how to set up an alert in Fresh Web Explorer for anyone who mentions (or links to) your two biggest competitors but not to you. Monitor your inbox for these alerts, and you'll find link new building opportunities ripe for the picking. Watch The Moz Daily SEO Fix: How to Build Links Using Fresh Web Explorer to learn how. To view more videos like this, be sure to check out The Moz Daily SEO Fix playlist on YouTube.
Moz Bar | | kellyjcoop2 -
Moz Crawler URL paramaters & duplicate content
Hi all, this is my first post on Moz Q&A 🙂 Questions: Does the Moz Crawler take into account rel="canonical" for search results pages with sorting / filtering URL parameters? How much time does it take for an issue to disappear from the issues list after it's been corrected? Does it come op in the next weekly report? I'm asking because the crawler is reporting 50k+ pages crawled, when in reality, this number should be closer to 1000. All pages with query parameters have the correct canonical tag pointing to the root URL, so I'm wondering whether I need to noindex the other pages for the crawler to report correct data?: Original (canonical URL): DOMAIN.COM/charters/search/mx/BS?search_location=cabo-san-lucas Filter active URL: DOMAIN.COM/charters/search/mx/BS?search_location=cabo-san-lucas&booking_date=&booking_days=1&booking_persons=1&priceFilter%5B%5D=0%2C500&includedPriceFilter%5B%5D=drinks-soft Also, if noindex is the only solution, will it impact the ranking of the pages involved? Note: Google and Bing are semi-successful in reporting index page count, each reporting around 2.5k result pages when using the site:DOMAIN.com query. The rel canonical tag was missing for a short period of time about 4 weeks ago, but since fixing the issue these pages still haven't been deindexed. Appreciate any suggestions regarding Moz Crawler & Google / Bing index count!
Moz Bar | | Vukan_Simic0