Thinking about deindexing 200,000 pages
-
So I was hit with Panda and Penguin. Since then I have been trying to figure out what is it that Google is seeing as "low content" on my site along with links. Concerning low content I am a dictionary based site and I have over 200,000 pages which link to sepecific definitions to words like /dictionary/word/a and so on. Most of these pages if not all have a bounce rate of 100% and very little to no traffic. I used to link every word in my database in my site which is where Google got the links from to begin with. Since then I have removed those links with no impact to my rankings, but Google still has them indexed. I am thinking about deindexing all of them from Google. So all my pages with /dictionary/word/[word here] would be removed. Just wanted to get some opinions on that. Maybe a good idea?
Also what would be the preferred method to deindex them.
Robots.txt?
noindex tag?
-
I decided to noindex all the pages, but I brought the links back that point to these pages but added the nofollow attribute as well to all of those. From a Google standpoint these pages are not worth indexing, but for user experience the links are needed.
Thanks
-
How many pages did you deindex?
-
If the pages are there for user experience only, and you dont expect any of these pages to rank, I would block google bot from scanning the pages/categories you want to remove using the robots.txt, as well as making the headers on all these pages no-index (for good measure)
Once you have set this up, you can request the url's to be removed in your G-WMT account.
We had loads of booking pages and media directories indexed, and this is what we did to get them out of the index. Not sure how it improves ranks, but it definitely tells Google which pages are most important preventing Google resources being spent on pages that are not important.
Hope that helps?
Greg
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Home Page & Most Important Category Page Cannibalizing Each Other
OK, so here goes. We have an odd situation on our hands. Our website sells a product technically known as "nail polish strips". We are a small player at the moment, but the reviews we've gotten in "side-by-side" comparisons vs. the big boys have been crazy, and literally always in our favor. Now the issue..... The best way to describe our product as mentioned above is they are Nail Polish Strips. Our domain name includes the term "Nail Strips" in it. Of the 200+ bloggers that have done reviews and provided us links, about 80% or so have linked to the home page, most just using our websites name, some have been nice enough to actually use keyword terms like nail polish strips. Moral of the story, for the term nail polish strips, our link profile would indicate to the google machine that our home page is stronger for this term. THE BIG ISSUE HOWEVER...... Our main category on the site that shows products is the page we originally intended to optimize for the term Nail Polish Strips. And our aim was going to be to optimize our home page for something else, like maybe plain old Nail Strips. THE BIGGER ISSUE...... At any given moment, Google is having a hard time figuring it out. Based on our link profile, we should be on page one, but what we're seeing is today, it's our Nail Polish Strips category page that ranks for that term, and tomorrow that listing will be replaced with our home page. Literally, last night the home page was on the top of page two, and today, the category page is on the middle of page two. They keep flip flopping. Sometimes they both appear within the first 3 pages, sometimes only one appears on page two, the other drops out of the top 10 pages. OUR THINKING IS....... Our home page obviously has more strength and if the google machine is even implying they like it for that term, we might as well accommodate that. Keyword spy shows this term has a volume of around 18,000 searches. The term isn't hugely competitive, so we planned to 301-redirect the current category page URL that is competing with the home page, to the home page, and re-create and optimize the category page for something different, like Nail Polish Stickers or something to that effect. THE FINAL ISSUE....... The term stickers in this industry as it relates to our product has been the victim of a negative PR campaign because the big boys (or girls) are trying to say "Nail Stickers" are garbage as opposed to "Nail Polish Strips". The problem is Nail Stickers gets a lot more traffic. So we figured, we'd optimize the category page for Nail Polish Stickers, and explain in the text, that despite what some of our competitors say, just because we're using the word "stickers" to describe them, doesn't mean they are bad, so on and so forth. I ONLY MENTION THIS SO YOU SEE WHY I'M HESITANT TO PULL THE TRIGGER ON OUR ABOVE FIX. I know this is long, and I'm not doing a great job of putting it in to words, but any insight will help. I'm supposed to pull the trigger today or tomorrow on this re-direct and new strategy, but don't want to do so until I get some of my fellow ninja's opinions.
Link Building | | AarcMediaGroup0 -
Unique pages per search phrase, Yes or No?
Hi People What is the general consensus regarding having bespoke pages for several search phrases? Should you have an individual page on your site for each main key phrase you want to target or should you target several phrases for each page e.g. Target 3 phrases per page. And if having separate pages for key phrase should there be links on site to these pages or is it enough just to have them in a site map? Thanks Andy
Link Building | | First-VehicleLeasing0 -
Best way to get over the Hump (from page 2 to page 1)
Hello, I've recently been able to bring my site way up in the rankings for some very competitive keywords. I've done nothing spammy, and everything has been done with a lot of detail and a focus on only using the best techniques. My site is on page 2 for a lot of keywords. What would be your suggestions for getting over that hump and making it to page 1? I'm happy with my results (coming from pages 30-50 to page 2 over a couple of months) but I'm not satisfied and won't be until I can be on the top of page 1... Any suggestions are welcome... Thanks
Link Building | | Prime850 -
Whats the quickest way to measure inbound linkes to an inner page?
Greetings from 12 degrees C just stopped raining wetherby Uk 😉 Whilst there is a stack of tools out there capable of measuring inbound links to a site i need a tool that can target a specific page and inform me about the origin & volume. Put another way i need to know what tool could tell me how many links this page is getting:http://www.sandersonweatherall.co.uk/office-to-let-leeds/ Thanks in advance,
Link Building | | Nightwing
David0 -
Domain authority or page authority in ranking
Hi, sorry if this is an obvious one... I am doing some keyword research tool and have a few keywords I wish to ran for. Looking at the DA of the sites on the first page they are averaging 60ish, my site is 33. However, for the keywords I am targeting they seem to have PA of 1, or at best, 5. From what I can make it out appears they are ranking for the keywords because of their strong DA rather than any seo work. If I were to target these keywords and send backlinks to the individual pages and so build up a PA on my pages would this be enough to challenge the competitors or would I still be at a major disadvantage because of my lower DA? Hope that make sense? I know what I mean but hard to explain it Thanks
Link Building | | ccgale0 -
Targeting high Page Authority sites vs high Pagerank sites for backlinks?
For many years I've been working on seo/backlinks for my website. When doing analysis in opensiteexplorer I notice that the highest listed backlinks for my site are sites with high page authority and domain authority, rather than pagerank. For example one of the highest backlinks for my website has page authority/domain authority of 72/96 but the site itself is only a PR2, while my other backlinks have PR4, 5, or 6 with lower page authority. For a while I've been trying to partner with websites for backlinks from high pagerank sites, as I've always believed this is the #1 metric in relaying link juice. But OSE's metrics seem to not follow that train of thought -- it believes page authority/domain authority is a more important measure. Is it? Should I change my strategy to try to partner with websites that have high page authority rather than focusing so much on pagerank?
Link Building | | DiamondJewelryEmpire0 -
One keyword per page?
I have a health insurance lead gen domain. One of the keywords I want to rank for are "student health insurance". If I have a related keyword like "aetna student health insurance", is it better to include that keyword and backlinks with that anchor text to my "student health insurance" page or do a separate page for that keyword?
Link Building | | yougotmymoney10 -
28,000 links - How to analyse sensibly
Hi My client has a large amount of back links. Does anyone have a simple way of analysing these and making sense of such a large dataset. Thanks
Link Building | | Big_Partnership0