Google has indexed a lot of test pages/junk from the development days.
-
With hind site I understand that this could have been avoided if robots.txt was configured properly.
My website is www.clearvisas.com, and is indexed with both the www subdomain and with out.
When I run site:clearvisas.com in Google I get 1,330 - All junk from the development days.
But when I run site:www.clearvisas.com in Google I get 66 - these results all post development and more in line with what I wanted to be indexed.
Will 1,330 junk pages hurt my seo?
Is it possible to de-index them and should I?
If the answer is yes to any of the questions how should I proceed?
Kind regards,
Fuad
-
Thanks Ryan.
-
It's impossible to say conclusively without examining your site and the content; however, since you refer to them as "junk" pages, it is likely they should best be removed to protect your other pages.
-
Thanks Ryan.
Are the un-wanted/irrelevant pages likely to affect my organic seo?
-
Thanks for your view David, its much appreciated. Thanks, Fuad
-
I would suggest following option 3 from David's recommendations.
Simply add the "noindex" tag to the pages you want removed from Google. The pages will then be removed the next time they are crawled.
You are correct the issue could have been avoided by blocking the site during development, which is a recommended practice; however, it is recommended to minimize entries in the robots.txt file of a live site. You can add the pages in robots.txt and Google can still index them.
The above applies if you feel the need to keep the pages around. If you no longer need those pages, removing them and providing a 410 error (GONE) would be the best approach.
-
Go to Google Webmaster Tools => Optimization => Remove URLS
In order for Google to remove the URL, you will need to do 1 of the following:
1. Block it with robots.txt, but it sounds like it's too late for that.
2. If you removed the old development content, make sure that the old content's URL produces a 404 or 410 status code.
3. Block the content with a Meta noncontent tag.
In my opinion, option 2 is the easiest since you should have a 404 page anyway.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google: What factors contribute to rank a landing page in a specific country?
Hi community, I would like to know what is the criteria to rank a landing page in specific country Google search. For example, if we want to rank our landing page for "GDPR Australia", what are the factors which will impact beside writing the cotent related to the above mentioned keyword? Thanks
Algorithm Updates | | vtmoz0 -
Old school SEO tools / software / websites
Hey Mozzers, I am doing some research and wonder if you can help me out? Before Moz, Hubspot, Majestic, Screaming Frog and all the other awesome SEO tools we use today what were the SEO tools / software / websites that were used for aiding SEO? I guess we can add the recently closed Yahoo! Directory for starters! Thanks!
Algorithm Updates | | RikkiD220 -
Bounce rates: Google vs others
Hello Mozzers, I was wondering if anyone could share some insight into how Google calculates bounce rates vs other analytics out there. We use both Google analytics and Clicky here. I've made several changes and additions to the website in hopes to increase traffic, optimization and reduce bounce rates. So far so good on all fronts. However I do notice bounce rates are way higher on google analytics than Clicky. While I get a bounce rate of 20%-29% on Clicky, Google has me way up the 50's or 60%s. I've read a few articles on it but I'm still a bit confused. Thanks!
Algorithm Updates | | md30 -
Site not indexed on Google UK after 4 days?
Hello!
Algorithm Updates | | digitalsoda
Wonder if anyone can help with this one? I have an ecommerce site www.doggydazzles.co.uk which went live on Friday and was submitted to Google via webmaster tools on saturday morning, but I can't find any trace of it in a google search?
I'm a bit stuck with this as its never happened to any of my other sites.
Can anyone help please or make suggestions as to what I can do to get ranked quicker? Thanks0 -
Is it normal to receive 2 mails from Google?
I filed a reconsideration request that was answered in less than a week. Subsequently I was told that no manual penalty was in place but various algorithm factors might be causing my heavy drops in ranking. Then I got a second email which was even more specific. This was great, really heartening stuff and a total surprise as it was very helpful. Is it normal to receive 2 emails from Google with such clear information? I have been very pleased by the comments they have made as it has shown me that they're more customer focused than I had been led to believe by all the research I had done pre reconsideration request. Has anyone else had a clear outline of what they needed to fix and has their site subsequently rebounded post fixing?
Algorithm Updates | | swimwithfishes0 -
When did Google include display results per page into their ranking algorithm?
It looks like the change took place approx. 1-2 weeks ago. Example: A search for "business credit cards" with search settings at "never show instant results" and "50 results per page", the SERP has a total of 5 different domains in the top 10 (4 domains have multiple results). With the slider set at "10 results per page", there are 9 different domains with only 1 having multiple results. I haven't seen any mention of this change, did I just miss it? Are they becoming that blatant about forcing as many page views as possible for the sake of serving more ads?
Algorithm Updates | | BrianCC0 -
How did my Page Authority and Page Rank disappear?
I've hit a problem. A couple days ago my site's page authority was 51 and the PR was 3 and now they're 1 and 0 respectively. The developer did adjust some of the code in the site in the past couple days but that shouldn't have affected this. It was last cached by Google on the 5th. Can anyone offer some good advice? If it helps the page is www.duracard.com
Algorithm Updates | | Andrea.G0 -
What are the differences between Google SEO and Bing SEO?
I came across this question on why the poster's rankings in Bing/Yahoo were so much lower than his rankings in Google. One of the links responded with was a presentation Rand gave about the difference in ranking elements of Google and Bing. My purpose for looking into this is to boost rankings in Bing to be more in line with my Google rankings. My takeaways from Rand's presentation were that Bing likes shorter URLs than Google and it's better to have more links from more root domains with more precise anchor text. Unfortunately this presentation was given at last year's SMX Advanced and is almost a year old. Since then Microsoft has been accused of basically scraping the Google SERPs and Google unleashed at least two maybe three rabid Pandas. Needless to say the environment has changed. So my question is for those people who are happy with how they rank in Bing: What SEO factors are you seeing make a bigger impact in Bing vs. how they impact your Google rankings?
Algorithm Updates | | rball11