How do i stop Moz from indexing my dev site?
-
Hey,
I am new to MOZ, and I am seeing in my page reports that I have duplicate content, but this duplicate content is mostly my development site. dev.domain.com. I have this blocked in robots.txt for google.
How do i stop MOZ including it in its reports?
Cheers everyone.
Bart -
Hi,
To stop moz crawler you have to mention below text in robots.txt for dev.domain.com
User-Agent: rogerbot Disallow: /
Hope this helps.
Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Is there anyway to cancel moz local?
Is there anyway to cancel moz local? I can not figure it out. I've tried for hours now.
Getting Started | | SouthBayWebs0 -
Best use of Moz Pro
Hello, I want to ask what are the benefits of Moz Pro other than finding low competitive keywords? I want to know the best use of Moz Pro for betterment of my site (chicken grill recipe). I want the best possible result. Guide me. Thanks.
Getting Started | | maxcharles0 -
What is the quickest and easiest way to run an SEO audit on a Wordpress site that at least shows all the mechanical problems?
What is the quickest and easiest way to run an SEO audit on a Wordpress site that at least shows all the mechanical problems?
Getting Started | | integratedproperty0 -
Can someone help me to gain Moz trust and domain authority?
Hi someone help me how to gain moz trust and domain authority for my web site. here is my web addresss: www.bassinotary.com/ please tell me how i can improve ranking for my site. please help. thanks.
Getting Started | | grbassi0 -
Multiple Google Analytics Accounts connected to the same MOZ subscription
Hi everyone, I have a quick question regarding setting up my MOZ account and it's
Getting Started | | Bernardo.Reguero
integration with a Google Analytics account: I'm not sure if I'm right but I think I can only set a single Google
Analytics account to do my analysis and then created several campaign. Or is there a possibility to set several Google Analytics accounts and creating several camapign to track diferente websites (connected to diferente Google Analytics accounts) ? Thanks! Cheers, Bernardo0 -
My website does not allow all crawler to crawl, Now my question is that whether i need to give permission to moz crawler if yes then whaat is moz bot name?
My website does not permit all crawler to crawl website. Whether ii need to give permission to moz bot to crawl website or not? If yes what is the moz bot name?
Getting Started | | irteam0 -
New to MOZ, can't create a campaign.
I just started the free trial today, but I can't setup a campaign. Everywhere I go (http://analytics.moz.com/pro/home, http://analytics.moz.com/manage-campaigns), all I see is: Oops! Try refreshing the page, if that doesn't work, please click here to contact our help team. Is something broken?
Getting Started | | jcsilkey0 -
Analytics stats not showing up in MOZ Campaign report
I connected a MOZ campaign to a client's Analytics. It seems it's connected properly with the same Analytics ID # and everything, but the stats still show 0 in MOZ, even though there are thousands of visits in Analytics for the same date range. Pls help! Derek
Getting Started | | DerekM42420