Does the Moz Pro site crawl, crawl password protected sites?
-
So i asked Moz Pro site crawl to crawl my page, and a lot of issues came up - but for password protected sites. Does the Moz Pro site crawl do this? A lot of the issues, are not relevant for a site that is password protected.
-
Hi there! Tawny from Moz's Help Team here!
Typically requiring a password to access certain pages on the site will prevent our crawler from reaching them, but if those pages are linked to somewhere else on your site, it's possible for our crawler to still find those pages.
This sounds like it might be pretty specific to your Campaign, so I would encourage you to contact us at help@moz.com and we'll do our best to sort through this with you.
Thanks!
-
No, none of them are. Most of them are about metadata or content issues. My impression were, that google or Moz for that sake, couldn't crawl sites you have to use a password to access? Thanks for your answer by the way
-
Hi there,
Were the issues that came up for the password protected pages all '403 Forbidden' errors/warnings? If so, I would not be concerned about this assuming that these pages should be blocked with a login. The Moz Pro site crawl will not be able to access these pages or properly analyze them.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Why is Moz so bad at finding lost backlinks?
0 -
Unsolved Moz link explorer is how much reliable and accurate as compared to others link explorer tools like Ahref
Hi.. I need to check backlinks for one of my client website duplicatebills through Moz Pro link explorer tool then its show that linking domain to this website are 90 but when i cross check these links from other tools like Ahref free backlinking tool then its show a different figure (ahref show that linking domain to this website are 103).
Link Explorer | | dbills
I am confused that which one correct. And MOZ link explorer tools in reliable to which extent?0 -
My Website's Links Are Not Showing In Moz Link Explorer
Hello Team, I was analyzing my domain (https://www.amzonestep.com) in link explored but there are many websites that are not showing there. Questions
Link Explorer | | amzonestep
1. Is this reason website's DA is not increasing 2. Is there wrong steps taken by me for this website. Well, I know there are many factors work in increasing DA but what is should do if these kind on links are not indexing in MOZ. I things these are one of the factors my DA is not Increasing. Please save my job guys. The company has sent me an ultimatum mail of 2 months that they will take back the projects from me. Please save my job. Thanks & Regards Aashirvad Kumar moz.png Screenshot-2020-02-19-at-11.48.21-am.png0 -
Angular SPA & MOZ Crawl Issues
Website: https://www.exambazaar.com/ Issue: Domain Authority & Page Authority 1/100 I am using Prerender to cache/render static pages to crawl agents but MOZ is not able to crawl through my website (https://www.exambazaar.com/). Hence I think it has a domain authority of 1/100. I have been in touch with Prerender support to find a fix for the same and have also added dotbot to the list of crawler agents in addition to Prerender default list which includes rogerbot. Do you have any suggestions to fix this? List: https://github.com/prerender/prerender-node/commit/5e9044e3f5c7a3bad536d86d26666c0d868bdfff Adding dotbot to Express Server:
Link Explorer | | gparashar
prerender.crawlerUserAgents.push('dotbot');0 -
Open Site Explorer not attributing page authority
Hi there, I have been having an issue with OSE attributing page authority to one of the sites I have been looking at. The homepage page authority is fine but any page after this does not have any according to OSE. I have been in touch with Moz and they have stated it's because there are no external or internal links pointing to any of these pages. However, I know that their are internal links pointing to these pages from the homepage in the nav. The domain is: https://healys.com/ If anyone has any ideas what may be going on that would be great. Thanks!
Link Explorer | | Alice-20160 -
[No Title] for all Top Pages at Open Site Explorer
49 out of the top 50 pages of the domain www.parallels.com shows [No Title]. I find this to be a major concern. Pages have long been established, title tags haven't changed recently. Am seeing a fair amount of 301 and 404s showing up, but actual OK 200 pages still showing [No Title]. Also seeing some decreases in organic search traffic at Google. Might there be a correlation?
Link Explorer | | ChristianMKG0 -
What's with Moz continuously pushing back the Index Update date?
Moz seems to keep pushing back the Index update date, it was the 24th until the 24th, then it got changed to the 30th, now it is may 5th.... What is the reason for this?
Link Explorer | | mgladman1 -
Why Moz Back links check tool is very Slow compared with other tools?
I've created a new website 50 days old with a vision of sharing high-quality content. I created some pages which are useful and helpful, what make other people link to my site. Early days, two weeks ago I've started checking my backlinks starting with Ahref and majestic. three days ago I decided to join Moz too and use Moz explorer. But, I discovered that Moz tool is too slow compared with other tools. Why? Starting with Ahref. They discovered more than 100 links and updating their data for my site as a new website every 6 hours as I know. Also majestic for the first time discovered six links then every two days they updating their data. Even Google discovered some of my backlinks. Specially links from high-quality sites such as Wikipedia with high-quality pages. Moz tool discovered zero of my backlinks even after subscribing. I don't think Moz need to discover websites like Wikipedia which already indexed by Moz. So, I wonder Why Moz tools are very very very slow like that? Update: (This is a question, not a discussion. So, please don't edit it) Can any Moz support answer please? Thanks.
Link Explorer | | Eslam-yosef0