How do i stop Moz from indexing my dev site?
-
Hey,
I am new to MOZ, and I am seeing in my page reports that I have duplicate content, but this duplicate content is mostly my development site. dev.domain.com. I have this blocked in robots.txt for google.
How do i stop MOZ including it in its reports?
Cheers everyone.
Bart -
Hi,
To stop moz crawler you have to mention below text in robots.txt for dev.domain.com
User-Agent: rogerbot Disallow: /
Hope this helps.
Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What does Location National means in Moz Pro Campaigns?
I understand the concept of locations in Moz Pro Campaigns. What does National exactly means? Is it like globally for a United States Google Search Rank or what? Please explain.
Getting Started | | ds9.tech1 -
SSL - green padlock but Moz say there's an 804 error?
Hi, my site has a green padlock and no SSL errors but Moz are reporting an 804 error. I use CloudFlare with fairly complex settings. I've read this thread but it's quite old and I don't understand which parts of it are still valid. I'd love to know whether this can be sorted before I spend hours setting up Moz's features as if they can't crawl my site then I would obviously need to cancel my subscription. Thanks
Getting Started | | Barn2Plugins0 -
What to believe Google's Comp or Moz's Opportunity/Potential graph
Hi! I'm newbie and I really don't know which info is best to dial in with the keywords. Google tells me that my keyword is in high competition, but Moz suggests that I have very high opportunity and potential with low difficulty with the same keyword... Maybe I need some sleep and come back later :-). Many thanks!
Getting Started | | PapaMilicia0 -
Error Selecting Search Engine During Moz Campaign Set-Up
Hi, I'm setting up a Moz campaign for a new client, and when I get to the third step, "Choose the search engines for which you would like to track rankings," there's nothing to select. No drop down, or anything, just a blank field under the heading. If I try to advance, I get an error pop-up that says I must select a search engine. Has anyone else run into this problem? What should I do? GlWPAsc zAmzqFf
Getting Started | | tommyKPseo0 -
Does Moz provide more than just the SEO Tool?
We've received a lot of good info about our website using the Moz analytic tools but I'm curious to know if Moz provides consulting services on how to implement changes based on the data. Basically, Moz gave me the "what", I need some direction on the "how" and does Moz have the in house capabilities to assist with the "who" can do the actual work.
Getting Started | | Elara1 -
In Open site explorer the page title and Url show in the left hand column. Why do some of my pages have no data for page title?
I am a first time user. Newly updated site using Drupal and having lots of SEO problems. Under site explorer, several pages list NO DATA for the page title. This doesn't seem right. Any suggestions on what this means?
Getting Started | | IV-Debbie0 -
Where to find answers to really dumb questions about setting up Moz campaigns...
I had a Moz account earlier this year, let it drop for a few months, then decided it really was important to have one. So I'm back. But there is still something about it that I really find frustrating. I can't seem to find any answers to what seem to be basic questions. Maybe they are too simple, maybe they are just dumb questions, but I sure would appreciate it if somebody could lead me to another source of information. Maybe somebody has written a "Moz for Dummies" book? Here's an example: I'm setting up campaigns for my websites, and I get to the Brand and Mentions section. It tries to autofill the space using my campaign name, but that's not accurate. So I go look at the Help Hub for Brands and Mentions, and it gives an example using MOZ as the brand name. But not many sites have a three-letter domain name, do they?. One of my domains is EasyDigging.com (2 words) and the other is BestDryingRack.com (3 words). So I look and look, but can't find any examples of longer domain names. So I have no idea how to enter my Brand. Should it be the whole "EasyDigging.com" or should it just be "EasyDIgging" or should it be broke up into "Easy Digging"? This is just 1 example. I find these sort of unanswered questions almost every time I try something new. Is there a collection of examples anywhere? I really hope so. Surely there are others who learn best from examples, who hate having to guess based on slim or vague instructions. Keeping my fingers crossed that somebody can lead me to the goldmine of good examples. Thanks!
Getting Started | | GregB1230