My website does not allow all crawler to crawl, Now my question is that whether i need to give permission to moz crawler if yes then whaat is moz bot name?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
MOZ flagging urls as longer than 75 characters when they aren't
As an example: https://www.abthermal.com/3m-70-70hdt-self-fusing-silicone-rubber-electrical-tape.html Moz has flagged this as URL too long... but guideline is that happens at 75 characters or more? I count 55..?? or does the 75 limit have to include the domain? Thanks, Adrian
Getting Started | | abtechgroup0 -
Moz Not Crawling Angular SPA
I have a client that just launched a redesigned website using Angular as a single page app. Google appears to be able to crawl the site just fine, but Moz crawl is only finding one page. We have updated the htaccess to allow for Rogerbot and Dotbot, but still unable to crawl any pages other than the home page. Does anyone have experience with this or ideas of why it won't crawl all pages, and how to allow for Moz to crawl all pages? There is a sitemap with approx. 390 pages. Thanks!
Getting Started | | PIN_Celler1 -
Standard Syntax in robots.txt doesn't prevent Moz bot from crawling
A client is getting many false positive site crawl errors for things like duplicate titles and duplicate content on pages that include /tag/ in the URL. An example is https://needquest.com/place_tag/autism-spectrum-disorder/page/4/ To resolve this we have set up a disallow statement in the robots.txt file that says
Getting Started | | btreloar
Disallow: /page/ For some reason this appears not to work, as the site crawl errors continue to list pages like this. Does anyone understand why that would be and what we need to do to properly disallow crawling these pages?0 -
Need to ad a virtual assistant to my account. How do I do that?
I have an assistant in Ukraine, I need her to have access to my MOZ account. How do I do that?
Getting Started | | RentFit0 -
Not able to access Moz pro page and my campaigns
Hi, I could not able to access my campaign pages (pro home page). I received the below issue while logged into my account. This webpage has a redirect loop The webpage at http://moz.com/pro/home has resulted in too many redirects. Clearing your cookies for this site or allowing third-party cookies may fix the problem. If not, it is possibly a server configuration issue and not a problem with your computer. Learn more about this problem. Error code: ERR_TOO_MANY_REDIRECTS I have checked on both firefox,chrome browsers after cleared the history and cookies. Also checked with different ISP providers. But received the same. Has anyone experienced the same? Plz help.
Getting Started | | HCSEO510 -
More problems with Moz - Monthly Reporting
Hello All, I may be missing something, but I only want to create monthly reports for my clients from this system. A week in SEO is a terrifying rollercoaster, but any I digress. Currently, i'm adding clients to the system, setting up Analytics, Twitter, Google+, keywords etc. I then go to the custom reports menu as I want to build my report now and schedule it to run at the end of the month, however, because a month has not yet passed, I can only create weekly report segments. This means that I have to add a client to your system and then come back a month later to build a report, this is silly, am I using this wrong or is this not right? I don't care if any data is available, I just want to create the report so I don't have to do it later ideally.
Getting Started | | Paul_Tovey1 -
Google Analytics data not loading into Moz
I use several analytics apps on my iphone which require you to connect to your GA account. Each one gets immediate access to the GA data. With Moz, I connected to my GA account 3 days ago after many failed attempts due to some bug, but still have no data showing. Is there some reason why Moz would take several days to access the data where iphone apps take seconds? I am now a week into my 30 day free trial, and have spent lots of time trying to get it to work, but have not been able to do much. I'm afraid of how much of the 30 days will be taken up just getting Moz set up and working, rather than actually using and evaluating what it does. Any possibility of re-starting the 30 days from when it's actually working? I don't mind waiting patiently for some bugs to be fixed, just would like to know that I will still get a 30 day trial. Thanks.
Getting Started | | RLodato1 -
Tracking Phrases in MOZ Analytics
I am currently using the 30 day trial of the MOZ Analytics tool to see if we want to continue. I know how to track one word key terms but how can I track multi word phrases? It only seems to pick up on the single word terms. Thanks to anyone that helps.
Getting Started | | Rategenius0