Page Optimization Error
-
Hello.
When I try to use 'On Page Grader' on specific site, I get an error message."
Page Optimization Error
There was a problem loading this page. Please make sure the page is loading properly and that our user-agent, rogerbot, is not blocked from accessing this page.
"
example : https://www.csgosmurfkart.comSite's robots.txt settings are good. and I think there's no blocking factor. But On Page Grader cannot crawl the sites.
But campaign crawler is working well on the site. only On Page Grader is not working..What should I change my server's setting or site's setting for crawling site on my site?
I'm using wordpress on google cloudThank you.
-
Hi - Thanks for posting.
I checked this url against our user-agent and it looks like we are being blocked with a 403 forbidden response when trying to access the page. This isn’t related to your robots.txt allowances, rather a server level block. You will want to work with your hosting admin or web developer to ensure our user-agent “rogerbot” is whitelisted so we can access the site.
We hope that helps to clarify, let us know if you have further questions we can assist with!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can a page have high Google/ organic traffic but show no ranking keywords in Moz?
We have a page on our website with a higher than average number of pageviews, 85% of which came from Google organic search. When I research this page by entering the URL into the "exact page" keyword research tool, Moz says it has no ranking keywords. How can a page be earning organic traffic without ranking for any keywords?
Moz Bar | | baystatemarketing0 -
Why do I get different results with On-Page Grader and Page Optimization tool? What is the difference between these two tools?
I use the Page Optimization tool to evaluate and make updates to a page until I get a grade of "A." But when I add the page and the keyword to the Page Optimization section of my campaign, it scores a 76% or 85% (which looks like a C or B to me). What would account for the difference in the evaluation results? Thanks for your help!
Moz Bar | | GLabs0 -
What are the best tools to help analyse on page optimisation for pages on development server and not currently live
currently using seo quake and moz tool bar but wondered if there is a better suggestion that will look at pages that are only accessible on the internal network on development server. Very restricted in what can be installed
Moz Bar | | Dan-Moz0 -
WP 4.0 Update Causing Major Duplicate Content Errors?
According to my moz analytics, my site has went through the roof with duplicate content. There's a nice Mozzer named Abe looking into this with me, but I'm wondering if it could be due to the WP 4.0 update. Has anyone else experienced an uptick like this before? I've never had any problems with the other updates. Thanks, Ruben
Moz Bar | | KempRugeLawGroup0 -
Why does the moz crawl test lists page twice?
Hi, I'm running into an issue where some crawlers list my pages twice, once with a trailing slash, once without. I first saw it on a few pages with screaming frog, then saw it happen on all my pages with the moz crawler. The site is www.kidsandart.org and its on Squarespace. I grepped the sitemap.xml I submitted to google webmaster and got 167 distinct pages, all of them without a trailing slash. Any insights on why this is happening, and how to regard moz crawler results would be appreciated. thanks Tom
Moz Bar | | tpushpathadam0 -
I'm getting a Crawl error 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag
The website is www.bigbluem.com and is a wordpress site. I'm getting the following error: 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag But what is weird is the domain it lists below that is http://None/BigBlueM.com Any advice?
Moz Bar | | TumbleweedPDX1 -
Can't get on page grader to work properly.
Hi I'm trying to optimize my pages with the on page grader tool but it keeps returning an F grade when I know my page is very well optimized. It is like something is blocking the page crawl but I have double checked my robots.txt and can't think of anything else that is causing a problem. I am trying to do www.hydrohobby.co.uk with the keyword hydroponics for starters but it is the same problem with all other page urls on my site and keywords I try to input. This is a new site made with cscart 4.0. I've graded pages on previous versions of this software with no problems. Can anyone help? Rob
Moz Bar | | hydrohobby0 -
Dupe content report showing in 'Errors' section when surely should be in 'Warnings' section ?
Why is the dupe content info showing in errors and not warnings ? Since if dupe content can get your site penalised (as per Panda) or worse banned, surely it should be in that section of reports ? Cheers
Moz Bar | | Dan-Lawrence
Dan0