Does the Moz Pro site crawl, crawl password protected sites?
-
So i asked Moz Pro site crawl to crawl my page, and a lot of issues came up - but for password protected sites. Does the Moz Pro site crawl do this? A lot of the issues, are not relevant for a site that is password protected.
-
Hi there! Tawny from Moz's Help Team here!
Typically requiring a password to access certain pages on the site will prevent our crawler from reaching them, but if those pages are linked to somewhere else on your site, it's possible for our crawler to still find those pages.
This sounds like it might be pretty specific to your Campaign, so I would encourage you to contact us at help@moz.com and we'll do our best to sort through this with you.
Thanks!
-
No, none of them are. Most of them are about metadata or content issues. My impression were, that google or Moz for that sake, couldn't crawl sites you have to use a password to access? Thanks for your answer by the way
-
Hi there,
Were the issues that came up for the password protected pages all '403 Forbidden' errors/warnings? If so, I would not be concerned about this assuming that these pages should be blocked with a login. The Moz Pro site crawl will not be able to access these pages or properly analyze them.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Disavow File Format and MOZ Spam Score Updates
Hi, Is there a defined file format for Google disavow file name? Does it has to be disavowlinks.txt or can we do this like domain-name-date.txt ? Also, since Google does not share their data with Moz, how does MOz updates its spam score after we disavow the bad links? Do we need to connect Google search console with Moz?
Link Explorer | | Sunil-Gupta1 -
Internal Pages marked as Spam by Moz
Hello,
Link Explorer | | Umesh-Chandra
We use Moz for our website,Open site explorer marks many of the internal pages of the website as spam. Even pages such as careers, privacy policy etc. Please let us know why is this the case ? Also does these pages have impact on overall rankings of the website ?, If yes, What should we do about it ? Please clarify. Thanks.0 -
Learn how to use Open Site Explorer to find opportunities in your links' anchor text. Get your Daily SEO Fix!
In today's Daily SEO Fix, Tori dives into using Open Site Explorer to find opportunities—particularly potential keyword ranking opportunities—in your links' anchor text. Watch "How to Use Open Site Explorer to Check Your Anchor Text" to get started! The Daily SEO Fix is an ongoing series of Moz tool tips and tricks in under 2 minutes. To watch all of our videos so far, and to subscribe to future ones, make sure to check out the Daily SEO Fix channel on YouTube!
Link Explorer | | MattRoney4 -
Local listings aren't being crawled?
Hello, SEO brainiacs. Here is the problem I can't figure out:We have a lot of clients and all of them have local listings, such as Insider Pages, Yahoo local, Bing locals, Yelp, Yellow Pages etc etc etc.
Link Explorer | | seomozinator
And all of those local listing have company's website link. But none of those links are considered (found) in reports, such as opensite explorer or in Link Analysis Section of Moz PRO. I do know that MOZ crawl considers only high DA websites, but all of local listing domains have above 80-90 DA score, so they can't be NOT crawled. I will say that some local listings do appear on very few reports, but far not all of them. So, what can be the problem?0 -
Does Moz allow you to upload your disavow to take into account when analysing links?
I was wondering if moz allows you to upload your disavow file and if it has a consideration in the data supplied? Otherwise how can we accurately use moz to understand the true analytics of our site?
Link Explorer | | MoneySite0 -
Getting "google bloking" in results of Crawl
What is the meaning of this in Excell results of crawling a website: multilingues.eu <colgroup><col width="165"> <col width="149"> <col width="139"></colgroup>
Link Explorer | | FernandoH.Silva
| | | |
| Blocking Google | Blocking Yahoo | Blocking Bing |
| | | |
| 312 | 14 | 187 |
| | | |
| 66 | 1 | 0 |
| | | |
| 46 | 2 | 1 |
| | | |0 -
Since January 24 Open Site Explorer has not provided new data
Using OSE we've been tracking our stats and our competitors stats on a weekly basis to see how we're doing. We've noticed that since Jan 24,2014 the numbers for us and our competitors have been the EXACTLY same. What's going on with OSE? Company_01.png
Link Explorer | | EricksonCoaching0 -
301 Redirects: How long for Google to recognize? How long for Moz/OSE to recognize?
I redirected a few pages that had funky URL issues (capitals and underscores and useless words) to the same page renamed with proper URLs. The sitemaps were changed also, and re-submitted. Like this: mydomain.com/Not_Pertinent_Words.html >>> mydomain.com/good-words.html Google seems to have found them and changed the search engine results listing in about 8 days. But it's been about a month now and Moz and OSE still have not transferred all the strength and link data from the old URLs to the new ones. Question 1: How long does it usually take Google to transfer all the link and strength data for a 301? Question 2: How long does it take Moz and OSE to do the same? Is there something I need to do to tell them about the changes?
Link Explorer | | GregB1230