Google has indexed a lot of test pages/junk from the development days.
-
With hind site I understand that this could have been avoided if robots.txt was configured properly.
My website is www.clearvisas.com, and is indexed with both the www subdomain and with out.
When I run site:clearvisas.com in Google I get 1,330 - All junk from the development days.
But when I run site:www.clearvisas.com in Google I get 66 - these results all post development and more in line with what I wanted to be indexed.
Will 1,330 junk pages hurt my seo?
Is it possible to de-index them and should I?
If the answer is yes to any of the questions how should I proceed?
Kind regards,
Fuad
-
Thanks Ryan.
-
It's impossible to say conclusively without examining your site and the content; however, since you refer to them as "junk" pages, it is likely they should best be removed to protect your other pages.
-
Thanks Ryan.
Are the un-wanted/irrelevant pages likely to affect my organic seo?
-
Thanks for your view David, its much appreciated. Thanks, Fuad
-
I would suggest following option 3 from David's recommendations.
Simply add the "noindex" tag to the pages you want removed from Google. The pages will then be removed the next time they are crawled.
You are correct the issue could have been avoided by blocking the site during development, which is a recommended practice; however, it is recommended to minimize entries in the robots.txt file of a live site. You can add the pages in robots.txt and Google can still index them.
The above applies if you feel the need to keep the pages around. If you no longer need those pages, removing them and providing a 410 error (GONE) would be the best approach.
-
Go to Google Webmaster Tools => Optimization => Remove URLS
In order for Google to remove the URL, you will need to do 1 of the following:
1. Block it with robots.txt, but it sounds like it's too late for that.
2. If you removed the old development content, make sure that the old content's URL produces a 404 or 410 status code.
3. Block the content with a Meta noncontent tag.
In my opinion, option 2 is the easiest since you should have a 404 page anyway.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What happens when we canonical and point to a page which has been redirected to another page? Google response!
Hi all, I would like to know the different scenarios Google going to respond when we use canonical and redirect for duplicate pages. Let's say A to B are duplicate pages with 95% same content and C Doesn't have same content but context wise similar and priority page we expect to rank for. What happens if we canonical from A to B and set redirect from B to C? What if both A and B are pointed to C with canonical? What if A or B deleted and other one is canonical to C? Note: We can noindex or 301 redirect as they have their own visitors. This is more about showing most relevant content to the audience and avoid duplicate content in search results. Thanks
Algorithm Updates | | vtmoz0 -
Have AMP pages on Chrome disappeared?
Hi, We amplified our site the other day and Google was quick to find our AMP pages. Today, we can´t seem to find any AMP pages on Chrome and it looks like we can´t find any other pages from sites like Wapo and so forth. They´re still visible on Safari. We are searching from Iceland. Is anyone experiencing this and if so, could you please share a link to the news? Thanks and have a nice day!
Algorithm Updates | | guidetoiceland0 -
Not showing in Google map listing. Why?
We have a client who's law firm is the highest google reviewed, on page two or three of St. Louis personal injury lawyer, but does not show in the map listing. Any ideas why this would happen or how to ensure they are viewable in the map listing?
Algorithm Updates | | David-Kley0 -
What is the new / current google algorithm update targeting and how to adapt / fix SEO approach accordingly ?
Over the past c. 3 weeks our average Google SERP rankings for a site have been as follows : week 1 : average 3rd in SERP week 2 : average 1st in SERP week 3 : average 7th in SERP Reading on sites including Moz, SEO Roundtable and looking at Moz's mozcast tool it seems there is allot of change going on with Google's algorithm at the moment. Is there a general consensus as to what the new algorithm update is targeting so that we can adapt our site / marketing accordingly ? Or is it too early to adapt ? When Google rolls out an update like this is it common to see fluctuations as they try out things or if we are currently down in the rankings should we take action now. I know there a tools that look at your google analytics data an overlay a list of major google updates such a penguin and panda, but from what ive read this is a generic algorithm change rather than a defined named update.
Algorithm Updates | | jpeg800 -
Google Unable to Access Robots.txt
We haven't made any changes to the robots.txt file and suddenly Google claims they can no longer access the file. The site has been up and active for well over a year now. What are my next steps? I have included a screenshot of the top half of the file. See anything wrong? D3H5tgE.png
Algorithm Updates | | rhoadesjohn0 -
Google Places Rank Replacement
Hi Guys We have recentley done work for a client where they ended up position 1 for their chosen keyword, which was great. Since then there rank has changed and they are now first in google places rank but not on organic search at all, where as before they were on both? Any suggestions on why this may have happened? Not to sure at why google would have replaced the organic rank with the places rank? Cheers Chris
Algorithm Updates | | MiracleCreative0 -
Is this a possible Google penalty scenario?
In January we were banned from Google due to duplicate websites because of a server configuration error by our previous webmaster. Around 100 of our previously inactive domain names were defaulted to the directory of our company website during a server migration, thus showing the exact same site 100 times... obviously Google was not game and banned us. At the end of February we were allowed back into the SERPS after fixing the issue and have since steadily regained long-tail keyword phrase rankings, but in Google are still missing our main keyword phrase. This keyword phrase brings in the bulk of our best traffic, so obviously it's an issue. We've been unable to get above position 21 for this keyword, but in Yahoo, Bing, and Yandex (Russian SE) we're positions 3, 3, and 7 respectively. It seems to me there has to be a penalty in effect, as this keyword gets between 10 and 100 times as much traffic in Google than any of the ones we're ranked for, what do you think? EDIT: I should mention in the 4-5 years prior to the banning we had been ranked between 15 and 4th in Google, 80% of the time on the first page.
Algorithm Updates | | ACann0 -
Google results on an Ipad 2
Has anyone else seen different google organic results for a site when viewing on an Ipad compared to computer browser ? I've just checked a site and were no1 on google when searched on the Ipad 2 but when searched on my Macbook we are page 2 ? Could this just be different data centers or do google serve up different results to the 2 devices ? Would be really interested to know if anyone else has seen this. JP
Algorithm Updates | | Prongo0