How do you de-index and prevent indexation of a whole domain?
-
I have parts of an online portal displaying in SERPs which it definitely shouldn't be. It's due to thoughtless developers but I need to have the whole portal's domain de-indexed and prevented from future indexing.
I'm not too tech savvy but how is this achieved? No index? Robots?
thanks
-
Fastest way to do it would be through a combination of Google Webmaster Tools and Robots.txt / noindex,nofollow meta tags.
Firstly if your domain hasn't been verified within GWT, go through that process. Then proceed with the remove URL request within GWT. (Image Attached)
You will need to upload a robots.txt and/or implement the noindex meta tag within the header of the pages you no longer want indexed.
Example Robots.txt:
User-agent: *
Disallow: /offendingportal/Example Robots Meta tag:
That should be enough to get rid of the offending content from within the SERPS and prevent it from being re-indexed.
-
Hi TCE,
There are two options in my opinion for this which are the best (as their are several other options including META robots etc):
- Robots.txt: Exclude your portal via your robots.txt file.
- HTTP Auth: Let your developers add HTTP Authentication so you have to log in to see the portal. Google won't be able to see the pages itself and so will de index them.
Hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Using same copy on different domain
I have a client that currently has a .com domain (not using hreflang) . They have a new partner in the UK and they want to replicate the website and use a .co.uk domain. It will be a different brand name. Will this cause any SEO issues?
Intermediate & Advanced SEO | | bedynamic0 -
What is best practice for "Sorting" URLs to prevent indexing and for best link juice ?
We are now introducing 5 links in all our category pages for different sorting options of category listings.
Intermediate & Advanced SEO | | lcourse
The site has about 100.000 pages and with this change the number of URLs may go up to over 350.000 pages.
Until now google is indexing well our site but I would like to prevent the "sorting URLS" leading to less complete crawling of our core pages, especially since we are planning further huge expansion of pages soon. Apart from blocking the paramter in the search console (which did not really work well for me in the past to prevent indexing) what do you suggest to minimize indexing of these URLs also taking into consideration link juice optimization? On a technical level the sorting is implemented in a way that the whole page is reloaded, for which may be better options as well.0 -
Indexing and Resolving to One www.domain.com format
People can come to a site www.domain.com in these 6 different ways. http://www.domain.com, www.domain.com, http://domain.com, domain.com https://www.domain.com, https://domain.com Obviously we don't want google to maintain an index for any more than one of these. What is the way to handle this? 301 redirects for all to resolve to www.domain.com? Or is that overkill? Or 302 redirects? Seems like a pretty basic issue but I'm not finding simple answers.
Intermediate & Advanced SEO | | friendoffood0 -
301 redirecting staff Domain to Company Domain
My colleague owns a domain (A) for about 10 years that he does not use. The domain's content is the same as my company's website (B) content.
Intermediate & Advanced SEO | | khi5
Question: Can I 301 redirect domain A to domain B's homepage or is it better he just closes down his website since this would not be SEO best practices? thank you0 -
Indexing based on location
Hi everybody. Bit of an interesting question. I have a client that wants to have the following pages on their site indexed: example.fr/home.html on Google.fr for users based in France
Intermediate & Advanced SEO | | Blink-SEO
example.com/fr/home.html on Google.com for users not based in France. So they wish to have both pages indexed in the end but not displayed to the same geographic users. Not entirely sure the best way to go about this, so any tips would be much appreciated!0 -
Changing Domain
We have an old domain that we have had registered for many years(pinpoint;asersystems.com) and redirected to our regular domain (which is a short version of our name (pinlaser.com). Management wants to switch and use the longer version as the primary domain for branding purposes. I have cautioned against this for many reasons: Need to do 100's of redirects Potential loss of back links Most links will now be 301 redirects and not look natural to search engines. I would appreciate feedback on any and all risks associated with this potential move. Thanks.
Intermediate & Advanced SEO | | Pinlaser0 -
Tips do join 2 domains
I would like to move all my old domain content ( dicasdogoogle.com.br) with more than 1200 tutorials pages to a new one (seomartin.com)... and then unify them. I´m using wordpress in both but the permalinks are different... Any tips 4 me folks?
Intermediate & Advanced SEO | | SeoMartin10 -
How do you build domain trust and authority ?
I am doing some link building and was hoping to get some clear information about the quality of the links and what I need to build a higher domain trust and authority. My sites page I wish to build for has: DA 22 PA 33 MR 4.6 I am looking at back links with these figures Considering outbound links are equal, which pages can help build my page ? page1 DA 66 PA 48 MR 4.8 page2 DA 66 PA 35 MR 3.75 page 3 DA 66 PA 28 MR 3.5 page 4 DA 41 PA 18 MR 2.73 Page 4 DA 41 PA 18 MR 1.87 Do I need back links with a Domain Authority Higher than my own ? PA higher than my own ? or MR higher than my own ? or would any of these pages be able to improve my own ? Thank you in advance for helping with this as I do not want to spend 6 months building the wrong links.
Intermediate & Advanced SEO | | jlane90