Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

My website does not allow all crawler to crawl, Now my question is that whether i need to give permission to moz crawler if yes then whaat is moz bot name?

Getting Started

1570

irteam last edited by

My website does not permit all crawler to crawl website. Whether ii need to give permission to moz bot to crawl website or not? If yes what is the moz bot name?
1 Reply Last reply
Reply Quote 0
MonicaOConnor last edited by

I don't know that you need to add permission, can you add a picture of your robots.txt file?
1 Reply Last reply
Reply Quote 1
Alick300 last edited by

Hi,

moz bot name is 'Rogerbot'.

Thanks
1 Reply Last reply
Reply Quote 1

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

How to rank website on google with help of Moz ?

I am new here and my question is how rank a website with moz because my website was not ranking in any keywords so plz guide me
Getting Started | | RoyDigitalWorld

0
Remove moz team conversation bubble

That little notification bubble on the bottom right corner of my account has finally gotten well beyond the point of irritation. Is there any way that I can permanently disable this?
Getting Started | | cslattery

1
Need support

Can someone please answer my question about not being able to not being able to access Social Overview? I originally posted this last week and haven't gotten a response. Thank you.
Getting Started | | Eric_Shew

0
What to start with? Moz also offers so much; what report should I start with?

As a new Moz user, what should I do first?
Getting Started | | Eric-Kinaitis

2
How to authenticate Moz crawler so that others don't use Rogerbot useragent to scrape data from our site?

Is there any way to authenticate genuine Moz crawler. Because, our website keeps getting scrapping attacks and if there is no way to authenticate Moz crawler, then, any scraper can just set user agent as Rogerbot and scrape all our pages. Is there a fixed IP that can be used or any other customization that will help us authenticate and allow only Moz crawler to crawl our site. Looking forward to a solution to this problem. We haven't been able to use Moz crawler due to this issue.
Getting Started | | longclimber

0
MOZ Monthly Custom Report Question

How do I set the Moz to produce monthly report on 1st of every month. I dont see any option there. we have 50+ Clients in Moz now and we need to generate report on 1st day of all month to send them report. Its 3rd Oct today and I don't see my previous month report being generated. Can you guys help me
Getting Started | | emarketexperts

0
Google + Business Page and Moz Pro

Is there a way to connect my Google + Business page with Moz? The only option I have available to connect when I press the button is my personal Google + Page. Thanks!
Getting Started | | BenhardtConstruction

0
Before making improvements, I need to collate the most relevant custom report to snapshot our current website quality.

I've just started at a company and before I start working on content and SEO improvements I need to assess 'where are we now' . The idea being after 3-6 months I can repeat the report to show improvements. Moz has an enormous range of powerful analysis tools - which should I combine into a Custom Report to create a snapshot of current website quality? Thanks
Getting Started | | ElementaryUK

0