On-Page Grader supporting HTTPS?
-
Hi there,
I am getting the error "Sorry, but this URL is inaccessible" on the Moz On-Page Grader. I have tested with multiple URL's but any that link to my site give the error. I have noticed my site's URL's redirect to https so my question is..is the on-page grader in-compatible with https?
Cheers!
Ross -
Oh good! I'm glad you were able to find the source!
We actually use a set of dynamic IPs, so there's not a range that I'd be able to provide. I'm afraid the best things I could suggest would be to ask them to whitelist our user agents, dotbot and rogerbot.
-
Thanks Jordan, it didn't make a difference but what I found was that my hosting company was blocking Amazon Web Services. They said they need a range of IP's from the cloud service that Moz uses to unblock, is there anyway you can advise me on what these are and is Amazon the cloud service that Moz uses?
Cheers!
-
I would expect that to take care of the issue
-
I've changed it too:
User-agent: rogerbot
Allow: /
Would this let Moz crawl the site?
-
Hmm I thought that too! It's strange though because my site is being indexed on Google and Moz is able to crawl it for other features. When I run the robots test in Google Webmaster Tools, the one where you run a test to see if URL's are blocked and you pick a bot e.g Googlebot...it says everything is working ok and it is allowed? Wouldn't that not be the case if bots were blocked from crawling the site?
-
Ah, yep, that would do it!
That configuration is currently blocking every bot known to man from accessing every portion of your site. Here's an awesome resource to help with robots.txt setup: http://www.robotstxt.org/robotstxt.html
If you were looking to allow all robots to access all pages on your site, then this command would do the trick:
User-agent: *
Disallow:
(Without the blank line between commands. Q&A formatting be damned.
) -
Hi Jordan,
Thanks a million for your response! I am still having the same issue..my robots.txt is as follows:
User-agent: *
Disallow: /Would this be blocking those bots? I know this blocks bots from accessing ALL content, but does it block all bots from accessing my site in general? Should I be changing it and if so, what would you recommend I change to allow for optimal crawling?
Cheers and thanks for taking the time to respond!
-
Hi Ross!
On-Page Grader should definitely function for https sites, in general. For example, https://moz.com looks to be working just fine.If you're getting that response from On-Page Grader, it's usually related to some sort of blockage. I'd recommend checking through your robots.txt to make sure that rogerbot and dotbot aren't being blocked, that your SSL is all looking good, and that the site isn't blocking Amazon Web Services (AWS).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Need help fixing a duplicate content issue for my website. The moz crawl is show OMG my website with https:// and https://www. But I have never used the url https:// so I don’t understand why moz is showing this
Moz is showing my url with two different starts. Https:// and then the one I use https://www. The problem is I don’t think I have ever used the url without the www. at the start. How do I fix this?
Moz Bar | | jdp_uk0 -
Page Grader states "includes Canonical Tag" but it's not in the page source at all
I've ran it multiple times and changed other things it picked up on so not sure where it's getting the canonical tag is included even though it isn't?
Moz Bar | | Wana-Ryd0 -
On Page Grader - URL not accessible
We have tried to use the On Page Grader today and it is coming back with URL not accessible for all pages on our website. We previously used the On Page Grader on Friday 10th Nov for a couple of product pages with no issues. Since then, the only changes we have made on the websites is updating some downloadable documents. We have done this several times before and it has never affected Moz. We have not changed the page URLs, and therefore do not know why it is now not working. The pages are working fine on the website with no issues. A link to one of the pages is below. http://www.processinstruments.co.uk/products/dissolved-oxygen-monitor/ Any help would be greatly appreciated.
Moz Bar | | PiMike0 -
Duplicate Page Content
The site crawl is registering duplicate page content for our storefront site, but the pages aren't the same. They're ascending pages within the same category (ex: Featured, Featured pg2, Featured pg3, and so on). What can be done to fix these errors or prevent them in the future?
Moz Bar | | MGuid550 -
Moz's on-page grader
Hello, I am having an issue with Moz's on-page grader. Grading the page, http://www.babyklar.dk/tigerspring/26-ugers-springet.html for the keyword 'Tigerspring 26 uger' I am receiving the error message: 'Exact keyword is used in page title' - tagging it as a highly important but easy fix. But I only have the words "Tigerspring 26 uger" in the title, so how can this not grade as Exact keyword? Is there somthing wrong with the system? Or is it me? Thanks very much. Best regards
Moz Bar | | Babyklar
Martin0 -
Clarify "broad keyword usage in page title"
Hello Page grader has two different grades for page title that I want clarification on. There is "Broad Keyword Usage in Page Title" and "Exact Keyword Usage in Page Title". Googling around about and searching here I have found that "broad" seems to mean the keywords should be used throughout the page, rather than just in the title and header. Which makes sense as this is a kind of check to ensure the page IS about the keywords and not something unrelated. But what is meant by "broad" usage in the page title? This refers specifically to the page title and not the whole document. My best guess got me to this, given the keyword "Visit London Today"; "Come and visit London today" - exact match only "London - visit today" - broad match only "Visit London the city of dreams | visit London today" - matches both That could be complete nonsense, but basically is broad usage the use of keywords scattered in the page title? Thanks.
Moz Bar | | yolkcreative0 -
How do you stop Moz crawling a page?
Hello, I have a contact form which generates thousands of duplicate crawl errors. I'm going to use to block Google indexing these pages. Will this also block MOZ from crawling these pages and displaying the error? Thanks!
Moz Bar | | Seaward-Group0 -
On-Page Grader Levels
I see that On-Page Grader reports include a numerical number such as the following: Keyword Usage for audio book gift certificates = 15 I improved this page (http://www.audiobooksonline.com/audio-book-audiobook-gift-certificates.html) from 3 to 15 today. What is the maximum "grade" possible?
Moz Bar | | lbohen0