How do you de-index and prevent indexation of a whole domain?
-
I have parts of an online portal displaying in SERPs which it definitely shouldn't be. It's due to thoughtless developers but I need to have the whole portal's domain de-indexed and prevented from future indexing.
I'm not too tech savvy but how is this achieved? No index? Robots?
thanks
-
Fastest way to do it would be through a combination of Google Webmaster Tools and Robots.txt / noindex,nofollow meta tags.
Firstly if your domain hasn't been verified within GWT, go through that process. Then proceed with the remove URL request within GWT. (Image Attached)
You will need to upload a robots.txt and/or implement the noindex meta tag within the header of the pages you no longer want indexed.
Example Robots.txt:
User-agent: *
Disallow: /offendingportal/Example Robots Meta tag:
That should be enough to get rid of the offending content from within the SERPS and prevent it from being re-indexed.
-
Hi TCE,
There are two options in my opinion for this which are the best (as their are several other options including META robots etc):
- Robots.txt: Exclude your portal via your robots.txt file.
- HTTP Auth: Let your developers add HTTP Authentication so you have to log in to see the portal. Google won't be able to see the pages itself and so will de index them.
Hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Migrating to a new domain
Hi The company I work for are planing to re-brand & come under our parent company name. This means the whole site will be moved to a new domain. Does anyone have any experience with this and can give me some useful docs to read/any advice? Thank you!
Intermediate & Advanced SEO | | BeckyKey1 -
Consolidating Multiple Domains into A Single Domain
I have a client who's website is an amalgamation of multiple domains. jacksonhole.net is the main domain but the site passes traffic back and forth from the following domains/sites. My questions is, would it it be better for SEO to consolidate all of these domains under the single high authority domain and 301 redirect the rest or is that a really bad idea? Thanks for your help. jacksonhole.net (Domain Authority 31) jackson-hole-rental-condos.com (Domain Authority 22) jackson-hole-rental-homes.com (Domain Authority 21) j acksonholehotelguide.com (Domain Authority 19)
Intermediate & Advanced SEO | | dbaxa-2613381 -
International Domains for SEO
My company is international and we have websites for each country with Country Code Top Level Domains (ccTLD). I am in the US and I am seeing that other countries such as Costa Rica and Germany are ranking above us in search results. I thought Google automatically geo-targeted users by default and therefore I should only get .com or US results. Any idea why other countries would rank above our site?
Intermediate & Advanced SEO | | fastlaneus0 -
Domain changed 5 months ago still see search results on old domain
Hi, We changed our domain from coedmagazine.com to coed.com in April'13. Applied 301 redirects on all pages, submitted 'change of address' to google but we still see site:coedmagazine.com fetching 130K results on google as opposed to site:coed.com fetches 40K results. Can anybody here throw some light on what might be going wrong? [ Site runs on wordpress, hosted with wordpress as well ] thank you
Intermediate & Advanced SEO | | COEDMediaGroup0 -
Primary Domain or Redirect?
We are starting a new travel guide for a resort town. I have bought an expired domain with decent related links and PR (which seems to have survived the transfer (4 months ago). Beofre we launch the new site I am trying to decide if we should use this expired domain as the primary URL for the new site or just do a permanent redirect and buy a new domain that better matches the theme of the site. I am obviously concerned with starting from scatch with a new domain. I am confident we can build some good rellevant links in a short time but this space is very competetive. Any input would be greatly appreciated.
Intermediate & Advanced SEO | | Locals0 -
What would be the best domain choice?
Hello I got a website www.keywordCA.com and I'm ranking #1 spot on "keyword" but what I notice if you have the exact match you get more site links and etc. Like this keyword that match with my domain name "keyword CA" The ideal name will be www.keyword.com but is taken and the owner don't want to sell the domain (at least he is not using it, is just parked) and I also got the domain www.keyword.net Do you think www.keyword.net will be much better than KeywordCA.com in order to get more exposure and google will generate more site links?
Intermediate & Advanced SEO | | jpgprinting0 -
Redirect index.php to domain address
The question says it all really. Google analytics shows me that my top 2 pages are my domain address and index.php, which are exactly the same. Is it best to leave it like this or redirect index.php to my domain address?
Intermediate & Advanced SEO | | CompleteOffice0 -
Exact match domain names
Hello, Someone approached a client of mine to sell a exact match domain name for a very competitive and high converting keyword. Would this be of any use and what are the best tactics to employ if it is purchased? I was of the opinion that the 'power' of exact match domain names are dying fast but would be interested to hear what people with experience in this think and what they have done with them (i.e. set-up a website on that domain or re-directed it)? Thanks, Rikki
Intermediate & Advanced SEO | | RikkiD220