804 error preventing website being crawled
-
Hi
For both subdomains https://us.sagepub.com and https://uk.sagepub.com crawling is being prevented by a 804 error.
I can't see any reason why this should be so as all content is served through https.
Thanks
-
I'm afraid that's the case if you're using Cloudfront
Our system really ought to be able to handle that type of configuration, but it's proving to be quite an undertaking to make those changes from an engineering perspective. So, I'm not really able to say when we'll be able to accommodate SNI with our crawler. Sorry for the trouble!
-
I should have read the whole thread...I read the first part.
We use Cloudfront so I guess Moz cannot crawl the sites
-
Hi there.
The problem would be misconfigured SSL.
There was same q&a here: https://moz.com/community/q/804-https-ssl-error
Read that, see if it answers your question
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why My Website DA is Not Improving
Is been a long time since the Domain Authority improved when Moz has last updated in March Month. After that, there is no DA activity happeing.
Link Explorer | | DiveshSeo0 -
Moz crawling http rather than https site
Our site is secure but when I ask moz to crawl it by giving the root domain including https moz insists on crawling the non secure version. How do i force it to crawl the secure version?
Link Explorer | | media12340 -
612 : Page banned by error response for robots.txt
Hi all,
Link Explorer | | ME5OTU
I ran a crawl on my site https://www.drbillsukala.com.au and received the following error "612 : Page banned by error response for robots.txt." Before anyone mentions it, yes, I have been through all the other threads but they did not help me resolve this issue. I am able to view my robots.txt file in a browser https://www.drbillsukala.com.au/robots.txt.
The permissions are set to 644 on the robots.txt file so it should be accessible
My Google Search Console does not show any issues with my robots.txt file
I am running my site through StackPath CDN but I'm not inclined to think that's the culprit One thing I did find odd is that even though I put in my website with https protocol (I double checked), on the Moz spreadsheet it listed my site with http protocol. I'd welcome any feedback you might have. Thanks in advance for your help.
Kind regards0 -
I'm doing a link audit and I want to download a spreadsheet of all the links to my website in OSE. There has to be a way to do that right?!
I'm doing a link audit and I want to download a spreadsheet of all the links to my website in OSE. There has to be a way to do that right?!
Link Explorer | | jennie.evans0 -
Crawling and Links - Showing Links
Hello I have a campaign in Moz that shows a new site as having no domain authority and no links. The site does have links to it, but they don't show up on OSE. Does Moz count links in the comments section of blogs (or is this counted as social, when the commenting system is one that requires facebook login?) I know blog comments are not great for SEO, I just use them when the post/link is 100% genuinely relevant. The site does have actual links on websites not just comment links, so it isn't showing any type of link. What is the best way to see the links the site has? Thanks!
Link Explorer | | wearehappymedia1 -
Error Code 612 with robots.txt 200
Hi! I am getting this message Error Code 612: Error response for robots.txt, so the crawler do not check any page of the site. The status code for the robots.txt is 200 and it does not seem Googlebot has any problem crawling the site, so I don't know what the matter is. The site is http://www.musicopolix.com/ Thanks so much in advance for any help!
Link Explorer | | Musicopolix0 -
Only two pages crawled
Hi community, I'm having trouble viewing data for all of our pages. Moz is only crawling two of our pages, and we have a lot more than that. Any suggestions? Thanks, Emily
Link Explorer | | SkuidEmily0 -
How can I get a list of all the links going out from my website
How can I get a list of all the links going out from my website and from which pages of my site. can I get this list using Moz, I also have ahref.com account, can I use that if yes how or do I need to use some other tools. Thank you
Link Explorer | | SinaKashani0