Dev Site Out of SERP But Still Indexed
-
One of our dev sites get indexed (live site robots.txt was moved to it, that has been corrected) 2-3 weeks ago. I immediately added it to our Webmaster Tools and used the Remove URL tool to get the whole thing out of the SERPs.
A site:devurl search in Google now returns no results, but checking Index Status in WMT shows 2,889 pages of it still indexed. How can I get all instances of it completely removed from Google?
-
Don'worry! It will take time. Google isn't lightning quick with drop requests or URL removals. They take time to filter out. Give it time and monitor it weekly to see they start to diminish
Cheers!
-
See my original post - I did that and in its WMT it still shows pages indexed.
-
Thumbs up on Mike and Robs comments. What you may want to do is to setup a GWT account for the dev.website.ext and then go in and delete it from within GWT. That will truly deep 6 it and then the robots.txt is the final blow.
https://support.google.com/webmasters/answer/1663427
Just leave the form blank when you request removal and it removes the entire subdomain. The robots.txt then makes sure it stays out.
-
As Mike said, it could take months for Google to remove all the indexed content from the DEV side (that was crawled and indexed). Looks like you did it all right too. I wouldn't worry, let it filter out. You won't be able to rush it any faster.
-
Hi David,
It sounds like you did everything right. As long as you cannot see the dev site in the live SERPs, you should be safe.
I have seen it take MONTHS for WMT to update any information regarding crawl stats, resolved errors, etc.
Just keep a close eye on things, but you should be safe if you can't find it by doing a Google search.
Hope this helps,
Mike
PS you may want to check Bing as well.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Old competitor site but GMB listing no more, are links still valuable?
One of my clients has come into the possession of a competitor's website. They sat on it for a while (other things going on) and because the company ceased trading the GMB listing seems to have been removed by Google and the leads have dropped off since this loss. The links are OK, so am considering 301 redirects, if the links still pass any value.
Intermediate & Advanced SEO | | GrouchyKids
Linking Domains 98
Domain Authority 23
Spam Score 2 % Are the links likely to still pass value? Also in terms of updating the WHOIS info what's the best approach?0 -
Truncated sitelinks in SERP
Anyway, I've seen these pop up for certain searches (not all). I'm curious as to how these truncated sitelinks appear. When searching for a company, the full sitelinks appear with descriptions and the like, but these little ones are a little new to me (apologies, I don't know if they have an official name). Is there a way to get them to appear for our page? Or more importantly, does it matter? iZlJZ
Intermediate & Advanced SEO | | Parker8180 -
Massive SERP crash
I came in this morning to a swath of email updates from Moz. Our site had jumped in ranking in the four geographic regions we target and we were seeing (more or less) the best results we've ever had. Most of the jumps were only 1 - 4 places but they were for our most competitive keywords. Late this afternoon I did some spot checks on keywords to confirm that we were still holding roughly in the same positions and before I reported this to the wider business. We're not. What's more we have dropped off the first page for some terms and don't seem to be ranked at all for for others. The only keywords we're getting good rankings for are branded search terms. I can only assume this is due to a technical issues over the weekend our developers caused. I'm not completely across this but I at some point our sitemaps stopped working and a huge number of links on the site were broken. Could a massive surge in 404s cause this? I'm checking google analytics and I can't see a drop in organic traffic yet although I don't have the full figures for today. Thanks
Intermediate & Advanced SEO | | ahyde0 -
Client has moved to secured https webpages but non secured http pages are still being indexed in Google. Is this an issue
We are currently working with a client that relaunched their website two months ago to have hypertext transfer protocol secure pages (https) across their entire site architecture. The problem is that their non secure (http) pages are still accessible and being indexed in Google. Here are our concerns: 1. Are co-existing non secure and secure webpages (http and https) considered duplicate content?
Intermediate & Advanced SEO | | VanguardCommunications
2. If these pages are duplicate content should we use 301 redirects or rel canonicals?
3. If we go with rel canonicals, is it okay for a non secure page to have rel canonical to the secure version? Thanks for the advice.0 -
Indexing based on location
Hi everybody. Bit of an interesting question. I have a client that wants to have the following pages on their site indexed: example.fr/home.html on Google.fr for users based in France
Intermediate & Advanced SEO | | Blink-SEO
example.com/fr/home.html on Google.com for users not based in France. So they wish to have both pages indexed in the end but not displayed to the same geographic users. Not entirely sure the best way to go about this, so any tips would be much appreciated!0 -
What happens when I redirect an entire site to an established page on another site?
Hi There, I have a website which is dedicated to selling ONE product (in different forms) or my main brand site. It is branded similarly, targets similar keywords, and gets some traffic which convert to leads. Additionally, the auxiliary site has a Google Rank 2 in its own right. I am thinking of consolidating this "auxillary" site to the specific product page on my main site. The reason I am considering doing this is to give a "boost" to the main product page on our main site which has many core keywords sitting with SERP ranking of between 11-20 (so not in first 10) Because this auxiliary site it gets traffic and leads in its own right, I don't want this to be to the detriment of my leads overall. Question is - if I 301 redirect the entire domain from my auxillary site to the equivalent product on my main site am I likely to see a large "boost" to that product page? (i.e. will I likely see my ranking rise from 11 - 20 significantly)
Intermediate & Advanced SEO | | love-seo-goodness0 -
Member request pages, indexed or no indexed?
We run a service website and basically users of the site post their request to get certain items fixed/serviced. Through Google Analytics we have found that we got lots of traffic to these request pages from people searching for those particular items. E.g. A member's request page: "Cost to fix large Victorian oven" has got many visits from searchers searching for "large Victorian oven". The traffic to these pages is about 40% of our Google organic traffic but didn't covert to more users/requests well and has roughly 67% bounce rate. So my question is: should we keep these pages indexed and if yes what can we do to improve the conversion rate/reduce bounce rate? Many thanks guys. David
Intermediate & Advanced SEO | | sssrpm0 -
On-Site Optimization Tips for Job site?
I am working on a job site that only ranks well for the homepage with very low ranking internal pages. My job pages do not rank what so ever and are database driven and often times turn to 404 pages after the job has been filled. The job pages have to no content either. Anybody have any technical on-site recommendations for a job site I am working on especially regarding my internal pages? (Cross Country Allied.com) Any help would be much appreciated.
Intermediate & Advanced SEO | | Melia0