What is the fastest way to deindex content from Google?
-
Yesterday we had a client discover that our staging URLs were being indexed in Google. This was due to a technical oversight from our development team (forgot to upload meta robots tags).
We are trying to remove this content as quickly as possible. Are there any methods in the Google Search Console to expedite this process?
Thanks
-
Excellent answer. Thank you very much.
-
Rosemary, in order to remove the content quickly, you have to do several things. You see, Google's processes for crawling, etc. and removing content from the index don't always happen all at once. So, it's best to do several things:
-
Remove the content. When visitors or bots visit the URL, use the "410 Gone" server header code to ensure that it's not just a 404 error being used.
-
If the content must stay and cannot be removed but still needs to be removed from Google's index, consider password protecting the content, putting it behind a paywall, making users log in to see the content, and/or adding a meta robots noindex tag on the page.
-
Add a robots.txt file on the subdomain so that it tells the bots to stop crawling. If you use something like dev.yourdomain.com for a dev section of the site, make sure that you have a robots.txt file at dev.yourdomain.com/robots.txt.
-
Use Google Search Console to remove the content. Once logged in, use the removal tool: https://www.google.com/webmasters/tools/removals?pli=1
By using several approaches, this is going to be the fastest way to remove the content.
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Click to Expand Content - Does anyone know if Google discounts this as a ranking signal ?
Hi All, I read an interesting answer from Tom Roberts on another question and one of things he mentioned was that there are conflicting reports about "Click to Expand " Content being discounted with a link to the article - https://www.seroundtable.com/google-hidden-tab-content-seo-19489.html My eCommerce uses this method on every landing page and tabs on our products pages so I am wondering if others had first hand knowledge of whether using these methods had affected their sites or not ?. I may try to experiment on a few pages to remove this and show all content at the bottom but it does kinda ruin the pages a bit so I wanted to know what peoples thoughts were before I screw up my pages and think about page redesign etc etc. Also , if I was to try it ,then how long should I experiment for ?. would a couple of weeks be sufficient providing google crawls them regually thanks Pete
Intermediate & Advanced SEO | | PeteC120 -
Google is not honoring my descriptions
I finally got our title tags honored and now Google is just making the descriptions whatever it wants. This is happening on pretty much every one of our pages. An example: http://www.sqlsentry.com/products/plan-explorer/sql-server-query-view SERPS = SQL Server MVP Aaron Bertrand shares a demo kit for Plan Explorer to give you better insight into the advantages of the tool, and to help you share its virtues ... Description tag = SQL Sentry Plan Explorer is a free query plan analysis tool that will allow you to find the most expensive operators by CPU, I/O, or both. I can see the description tag when I view source so I know that it is pulling it from the table correctly. What can I do to fix this?
Intermediate & Advanced SEO | | Sika220 -
All Thin Content removed and duplicate content replaced. But still no success?
Good morning, Over the last three months i have gone about replacing and removing all the duplicate content (1000+ page) from our site top4office.co.uk. Now it been just under 2 months since we made all the changes and we still are not showing any improvements in the SERPS. Can anyone tell me why we aren't making any progress or spot something we are not doing correctly? Another problem is that although we have removed 3000+ pages using the removal tool searching site:top4office.co.uk still shows 2800 pages indexed (before there was 3500). Look forward to your responses!
Intermediate & Advanced SEO | | apogeecorp0 -
The right way for review count?
Hi, I have a question that kinda bothers me for a while now and would love to hear you guys thoughts on this matter. One of the categories in my websites is services reviews, for example:
Intermediate & Advanced SEO | | Ouzan
http://www.websiteplanet.com/review/questionform/ Recently we upgraded the site and gave users the option to write their own review as well. Now as you can see, the way it works is that we write a very big and informative/professional review ourself and in addition we give users the option to write their own reviews and share their experience with the service. Now My question is:
There is the itemprop-review count thingy, now we did it so if 0 users wrote a review it will show 0 reviews on the count.
Is it correct? (Feel free to check the site code yourself)
Or is it wrong? because their is actually 1 review (our editors review) I hope I explained my self well...
If not, please let me know what is unclear. Thanks!0 -
Post your 3 best ways to rank well on Google
Hi, Anyone care to share what are your 3 best ways to rank well on Google? As for me i think: 1.) Link building & Social Media 2.) Onsite optimization 3.) Quality Content What about you?
Intermediate & Advanced SEO | | chanel270 -
Can links indexed by google "link:" be bad? or this is like a good example by google
Can links indexed by google "link:" be bad? Or this is like a good example shown by google. We are cleaning our links from Penguin and dont know what to do with these ones. Some of them does not look quality.
Intermediate & Advanced SEO | | bele0 -
Google Local oddity
So I spotted something a little weird... one of my client's Google Local placements in blended results has the domain name - complete with the .com extension appearing where the business name typically appears: Businessxyz.com www. businessxyz .com of Google reviews Has anyone seen this? I setup their Google Places account quite some time ago and used the business name - not the url. I also setup their Google+ and Local page - using the name. None of the page titles on the website contain the url. I simply can not pinpoint where G is pulling this from or why for that matter. All competitors are appearing with business name - only my client has the domain name visible for the particular local search query. Any ideas?
Intermediate & Advanced SEO | | SCW0 -
Duplicate content
I have just read http://www.seomoz.org/blog/duplicate-content-in-a-post-panda-world and I would like to know which option is the best fit for my case. I have the website http://www.hotelelgreco.gr and every image in image library http://www.hotelelgreco.gr/image-library.aspx has a different url but is considered duplicate with others of the library. Please suggest me what should i do.
Intermediate & Advanced SEO | | socrateskirtsios0