How do i stop Moz from indexing my dev site?
-
Hey,
I am new to MOZ, and I am seeing in my page reports that I have duplicate content, but this duplicate content is mostly my development site. dev.domain.com. I have this blocked in robots.txt for google.
How do i stop MOZ including it in its reports?
Cheers everyone.
Bart -
Hi,
To stop moz crawler you have to mention below text in robots.txt for dev.domain.com
User-Agent: rogerbot Disallow: /
Hope this helps.
Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Free
hello guys, is there any way to use Moz free or any well-known company who would like to give me Moz login at a very cheap price. if anyone knows then please guide me shortly. Thanks With Regards, Abert sin.
Getting Started | | seochris172 -
How long does it take, So i can see results of Kewords Ranking search on moz?
Hi, I m the new guy at the Neighborhood Can you help please with the question... how long does it take, So i can see results of Kewords Ranking search on moz? This is the popup note Message: Moz collects and updates campaign data weekly. Not collected means we have not yet updated data for this keyword. TNX
Getting Started | | YarivHPAZ1 -
Standard Syntax in robots.txt doesn't prevent Moz bot from crawling
A client is getting many false positive site crawl errors for things like duplicate titles and duplicate content on pages that include /tag/ in the URL. An example is https://needquest.com/place_tag/autism-spectrum-disorder/page/4/ To resolve this we have set up a disallow statement in the robots.txt file that says
Getting Started | | btreloar
Disallow: /page/ For some reason this appears not to work, as the site crawl errors continue to list pages like this. Does anyone understand why that would be and what we need to do to properly disallow crawling these pages?0 -
Setting up Moz Pro campaign for a subfolder
Hi, I'm just setting up my first campaign and would like some advice please. I have a website and also within it a a number of pages in a sub folder. These are technically a different business to the main website and I would like to track them separately in Moz so they can have their own keyword lists and competitors etc. How do I do this? Do I set up two separate campaigns www.site.com
Getting Started | | craigramsay
www.site.com/subfolder I understand the first one might still report on the subfolder but I guess I could just ignore this. Thanks0 -
Moz Pro for Local Catering Company?
Is Moz Pro or Moz Content useful for a local catering company? I've started a trial to try to determine if it will benefit us. Our new site will be up next week so we don't currently have traffic. We will be using some Adsense and direct mail campaigns to get started, but not sure if Moz local will be sufficient. Please help connecting the dots. I know it would be good to rank higher for example "Catering Tahoe, Ca." But how would Moz help me see what kind of content to create for a local catering company? I'm not sure a blog article makes sense.
Getting Started | | Nasoj0 -
Moz health check for newbies
Hi I'm on the free trial, I'm finding it really useful. since I was 16 (16years ago) all I've done is cook. After 3 weeks of Moz I feel like I'm or the way to marketing my business instead of having others tell me how to do it. A while back I used to use SEO freelancers to buff my site, but recently I realized that I was not doing enough to promote my business myself, I was trying to pay others to do it for me. I goggled Soe and marketing, of course I found Moz while doing so! The content is exceptional and really goes in depth and we are now coming up with a new content strategy! The problem is that I have this gut feeling that The moz product is worth the money it asks for as I can easily identify the issues or opportunities my site has, I still feel that I lack the competence to use moz to its full potential! Is there an option to have someone skpe me and give me some tips or in sites with in my own campaign? I've spent a lot of time reading the blog content and watching the videos but this all seams to focus on how to get results but not so much on how to use the Moz console/dashboard. I've probably just missed a hole bunch of content but if not do Moz have and option to help set up your Moz analytic and Research so you can get the most relevant info to you? Any help is most welcome Kind regards Ben Horle SussexChef.com
Getting Started | | SussexChef831 -
Why Moz New Users Are Left Alone?
New users when sign up to an application like Moz need concrete support to make them familiarized the basics at least, but Moz seems to be not realizing this hardship of the new users or intentionally ignoring it. There is no chat service or phone numbers to quickly contact the designated agent for some quick help. Mail responses that are received after much time have their limitations -- not much interactive. What the new users should do, because the Moz is not that simple for new users. [edited question for formatting]
Getting Started | | Sequelmed1 -
Fastest way to set up Moz to produce a list of easy-to-rank for keyword opps
I've used Hubspot's keyword tool previous to MOZ, and I know that they import data generated from MOZ into their tool... but I find it a much more convoluted process using Moz's more robust system. ALL I want is to dump in a long list of keyword possibilities, then see where we can easily rank for these terms, especially against our local competitors. How do I set this up???? It's not as self-explanitory as Hubspot! Thanks!!!
Getting Started | | uptongirl340