Thinking about deindexing 200,000 pages
-
So I was hit with Panda and Penguin. Since then I have been trying to figure out what is it that Google is seeing as "low content" on my site along with links. Concerning low content I am a dictionary based site and I have over 200,000 pages which link to sepecific definitions to words like /dictionary/word/a and so on. Most of these pages if not all have a bounce rate of 100% and very little to no traffic. I used to link every word in my database in my site which is where Google got the links from to begin with. Since then I have removed those links with no impact to my rankings, but Google still has them indexed. I am thinking about deindexing all of them from Google. So all my pages with /dictionary/word/[word here] would be removed. Just wanted to get some opinions on that. Maybe a good idea?
Also what would be the preferred method to deindex them.
Robots.txt?
noindex tag?
-
I decided to noindex all the pages, but I brought the links back that point to these pages but added the nofollow attribute as well to all of those. From a Google standpoint these pages are not worth indexing, but for user experience the links are needed.
Thanks
-
How many pages did you deindex?
-
If the pages are there for user experience only, and you dont expect any of these pages to rank, I would block google bot from scanning the pages/categories you want to remove using the robots.txt, as well as making the headers on all these pages no-index (for good measure)
Once you have set this up, you can request the url's to be removed in your G-WMT account.
We had loads of booking pages and media directories indexed, and this is what we did to get them out of the index. Not sure how it improves ranks, but it definitely tells Google which pages are most important preventing Google resources being spent on pages that are not important.
Hope that helps?
Greg
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will these pages harm the SEO of my blog?
Hi there, If I put download pages and thank you pages on my blog, will it harm the SEO rankings? As these pages will be pretty thin and will have no links to them internally for obvious reasons, it has me concerned about the effect it could have on my blog. I want to build my blog up to drive traffic, so it's not just a case of throwing the pages up. What is the best solution? No index the pages -- will that be enough? Warm regards Colin
Link Building | | username670 -
Wrong page ranking and rank drop, help!
Dear Moz community I would like to hear your advice about our current SEO problems. Our website is www.poolsonline.nl. This is a website where people can learn the Polish language on our website. This website has been online since 2007. The website got really outdated, so we built and launched a new version on March 1st (one month ago). We have created a salespage that we would like to rank for the keywords 'cursus Pools' (Polish course) first of all and 'pools leren' (learn Polish) secondly. The page is https://www.poolsonline.nl/cursus-pools-leren-spreken/ The old website was on rank 4-5 (roughly) for 'cursus Pools' and 'pools leren'. When we launched the new website we were on the top 5 with two of our pages. We were even on rank 1 and our salespage was also showing on the first page and often also in the top 5 (below the 'wrong' page of ours). We got quite a lot of trafic and new clients. However the problem was that the wrong page was ranking higher. We wanted our salespage to rank and not our home page (https://www.poolsonline.nl/) and not our free lesson (https://www.poolsonline.nl/lessen/groeten-en-gesprek-voeren-in-het-pools-les-1/). So what we did: Read/watched recourses about this problem: https://moz.com/blog/wrong-page-ranks-for-keywords-whiteboard-friday and https://moz.com/blog/wrong-page-ranking-in-the-results-6-common-causes-5-solutions and others. Removed the keywords (cursus pools en Pools leren) from the wrong pages (home and free lesson pages). Optimized the Salespage for these keywords Improved internal linking with these key words to our salespage Worked on link building for our salepage. We got about 5-10 links to our salespage in the first week of March (5 seems to be significant for this competition and we are working on more). These links are not yet in Moz OSE, but Google has indexed these pages and links. For reference, here are some of these links (not all): http://www.iculture.nl/apps/ik-spreek-pools-taalcursus-pools-op-iphone/ http://linktopoland.com/nl/cursus-pools-leren-spreken/ http://naukaholenderskiego.pl/artykuly/aplikacje/rozmawiamy-po-niderlandzku-aplikacja-na-iphone-i-ipad/ http://pnkv.nl/nieuwsbericht.php?bericht=rozmowy-po-polsku-juz-po-6-miesiacach http://poolsewoorden.nl/pools-leren/aanmelden/ http://poniderlandzku.nl/ Shared and promoted our salespage on social media What we expected: Our salespage to show up on top for these keywords Our ranking to improve What happened: Our salespage disappeared all together from the search results for these search terms (it does show up for more specific search queries, for example 'cursus pools leren spreken') Our site seems to keep dropping lower and lower. We are now on the bottom of page 1 or on page 2 for 'cursus Pools' and 'Pools leren' and not with the desired page Questions we have for you to help us: Why do you think our salespage is not showing up anymore for these keywords ('cursus pools' and 'pools leren')? Do you think we got a penalty for over optimization or bad links? What can we more to get our salespage to rank for these keywords? (we are working on building/earning more links) What can we do to restore our rankings and not drop lower anymore? Do we need to give our efforts more time? How long? Any other adivce? Thanks so much in advance!
Link Building | | rdudkiewicz0 -
Multiple on-page links to single domain
Hi, the main focus of my question is to add a bit more information to my client as to where they are going wrong. Firstly they have a directory on a third party domain with subdirectories containing all their product listings. All the links need to be no-follow for sure. However, from a link juice passing perspective if there are per page say 20-30 links to varying URLs on the same domain is it still the same sort of calculation that the link juice is sufficiently weakened that each link has little value, or because the links are to the same domain there is an extra (potential) filter going on?
Link Building | | MickEdwards0 -
SEO Drop rename pages
Some of key product pages have dropped due to what I think is overused anchor text. Can we rename them, and start again?
Link Building | | jj34340 -
Why Breadcrumbs don't work on my web page?
I tried 2 types of breadcrumbs plugins. Last - Yoast
Link Building | | NadiaFL
Breadcrumbs. But result is the same - they don't show up in the footer. I
followed direction and made settings - result is the same. Any ideas? Thank you! http://oasisoftheseasallureoftheseas.com/0 -
Link Building and Landing Pages
I'm embarking on my first link building campaign and I was wondering if its good practice to develop a specific landing page (a focused summary page) like I do in my PPC campaigns or should I use the URL to my homepage?
Link Building | | bmackrell0 -
Link Bait - Directory Style Resources Page
Hello Mozzers! Basically I want to add a beefed up "resources" page (directory style) to my site to attract in bound links. Below is an example of a site that has a similar directory style resources area. http://www.petfinder.com/shelters.html I was thinking that it might be good to add a resource box in my site footer with links to these resource pages such as: 1) Dog breeder resources
Link Building | | k9byron
2) Dog training resource
3) Dog shelters/kennels
4) Pet health resources
5) Pet care resources And funnel links to my category pages from there .. I was looking for some feedback or any tips or the best way to go about doing this and if anyone knew of a SE friendly script or something that that I might be able to integrate with my site (x-cart / PHP) platform that would make it easy to populate / update, ect Below is a paste of how one person I talked to envisions it: I'd suggest building some pages of value, such as dog resources pages (rescue groups & resources, etc.), adoption resources, etc. I'd guarantee if the resources were very comprehensive and built correctly, you'd get more bang for the buck versus throwing hundreds (or even thousands) away on sub-par links. Case:
http://www.tnj.com/black-history-makers/major-inventions-african-americans (a simple test content page to show this client we could build lifetime links with a few hours of work for a decent-sized resource page) Although very ugly, this is more of a gold mine for links taking the example above:
http://www.enchantedlearning.com/inventors/black.shtml This is just one simple example but I hope you get the concept versus ongoing payments for junk links.The more links you get to internal pages - even the resource guide pages - the more opportunity to link back to core product pages contextually or within the content portion of the page of side columns. The goal is to create funneled links from these resource pages back to your other pages, but doing it in a manner that's not outlandish or spammy in nature.0 -
Linkbuilding from sites with lower Domain Authority and Page Rank than mine?
I have decided to approach all my suppliers and ask them for a link. If their site has a lower PR/DA than mine (PR4, DA43) is is it still worth asking them from a link, given the time that needs to be invested in this type of link building?
Link Building | | Tman30