Thinking about deindexing 200,000 pages
-
So I was hit with Panda and Penguin. Since then I have been trying to figure out what is it that Google is seeing as "low content" on my site along with links. Concerning low content I am a dictionary based site and I have over 200,000 pages which link to sepecific definitions to words like /dictionary/word/a and so on. Most of these pages if not all have a bounce rate of 100% and very little to no traffic. I used to link every word in my database in my site which is where Google got the links from to begin with. Since then I have removed those links with no impact to my rankings, but Google still has them indexed. I am thinking about deindexing all of them from Google. So all my pages with /dictionary/word/[word here] would be removed. Just wanted to get some opinions on that. Maybe a good idea?
Also what would be the preferred method to deindex them.
Robots.txt?
noindex tag?
-
I decided to noindex all the pages, but I brought the links back that point to these pages but added the nofollow attribute as well to all of those. From a Google standpoint these pages are not worth indexing, but for user experience the links are needed.
Thanks
-
How many pages did you deindex?
-
If the pages are there for user experience only, and you dont expect any of these pages to rank, I would block google bot from scanning the pages/categories you want to remove using the robots.txt, as well as making the headers on all these pages no-index (for good measure)
Once you have set this up, you can request the url's to be removed in your G-WMT account.
We had loads of booking pages and media directories indexed, and this is what we did to get them out of the index. Not sure how it improves ranks, but it definitely tells Google which pages are most important preventing Google resources being spent on pages that are not important.
Hope that helps?
Greg
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Need advice: How to replace a high-ranking pdf with a landing page -- without dropping much in rank?
Hi! We have a pdf of a white paper on our site that ranks #1 for a niche term. We are now exploring the idea of building a landing page for this paper with an overview (2-3 paragraphs) and a registration form for interested parties to fill out in order to access the paper. Do you think there'd be any hope of ensuring the new landing page would rank almost as well eventually (top 3)? I'm thinking a key consideration would be preserving the link juice from the existing links that are coming into the pdf, and that 301 redirecting the pdf URL to the new landing page URL could help with that. Am I right? Or would it be better to try to reach out to the linking sites and ask them to update their links (seems daunting). Any advice/opinions on this situation would be appreciated. (If folks think that there would be a significant risk of permanently dropping out of the top 5 by attempting this, we would likely choose to leave the pdf ungated as is.) Thanks!! -John
Link Building | | jomosi0 -
Has anyone seen a recent drop in Page Authority?
We have seen a sizeable drop in Page Authority for three of our key category pages over the last one week.The total number of linking root domains has increased for all the three pages. We have disavowed a few spammy links but we doubt that would cause a drop in page authority. The domain authority is unchanged.Is there any way we could figure out the cause of the drop? Has anyone else also noticed a drop in page authority for their pages? Hello,We have seen a sizeable drop in Page Authority for three of our key category pages over the last one week.The total number of linking root domains has increased for all the three pages. We have disavowed a few spammy links but we doubt that would cause a drop in page authority. The domain authority is unchanged.Is there any way we could figure out the cause of the drop? Has anyone else also noticed a drop in page authority for their pages?
Link Building | | vikassocialbeat0 -
Second anchor text on page. Does it count?
Back in 2008 there was "proof" that the anchor text of a second link on a page would not be counted for the anchor text.
Link Building | | Stramark
In the MOZ starter guide it is still advocated: https://moz.com/learn/seo/anchor-text BUT in 2014 it was reported on searchengine land:
http://searchengineland.com/googles-matt-cutts-one-page-two-links-page-counted-first-link-192718
That the second link might be counted. Direct link to the matt cuts video from 28 may 2014
https://www.youtube.com/watch?v=5AsLWIuNNMU (Even in 2010 there where already some different opinions and work arounds.
https://moz.com/blog/the-first-link-counts-rule-and-the-hash-sign
https://moz.com/ugc/3-ways-to-avoid-the-first-link-counts-rule (2011) Question: did anyone recently test this recently? The deeper questions are:
1:is the LINK value counted if you have more that one link on a page to another page?
2: is the Anchor text counted if you have more than one anchortext to another page? The most interresting i have is that i have a menu from which i link to my important pages. Does it help to put extra links in the content to specific pages?1 -
How to handle bad DoFollow links to pages on my site that no longer exist
I briefly had a forum on one of my sites, but after getting inundated with spam I decided to remove it for the time being. During the brief time it was up, most of the spammers were stopped from registering, but a few managed to get through and posted tons of links to their prescription drug sites. These posts were deleted almost instantly, but the spammers also created DoFollow backlinks on high authority community sites like ning. The forum posts they linked to were deleted immediately, so the links never went anywhere and the forum has been deleted entirely for a few months now. When clicked, the spam backlinks now bring someone to a "Sorry, that page doesn’t exist" page on my site. My site suffered a bit in the last Panda update and it made me look through my backlink profile, finding lots of these links - even though the pages on my site are long gone, could these links be hurting my site? Can a DoFollow link to a site help or hurt the main domain, even if the actual page it's linking to is deleted?
Link Building | | adventurenick0 -
Blog snippets on home page
Mozzes, We're running a real estate portal in which we have a pretty good news/blog section running on wordpress. It's placed into our LAMP site on a dash from our root URL: www.ourportal.com/news/ To attract traffic via our landing pages we publish article snippets from the blog, linked to the complete articles. What would be the optimal SEO here to lead the spiders to the orignal content? Follow, Noindex? Best Johan
Link Building | | PropertyPortal1 -
Page Rank Update
I was hit by Google’s latest Page Rank update. I know “don’t be obsessed with Page Rank”, but it concerns me. I thought that I was developing a very good link profile and actually was hopeful that it would go to a PR-5 and it dropped to a PR-3. www.simply-bags.com I have another site www.keepsakes-etc.com and have done very little link building and it also dropped to a PR-3. Can anyone give me some honest feedback about my concern?
Link Building | | b4tv0 -
Should I 301 Redirect The index.html Page?
Hello, As an experiment I am trying to work with an SBI site but am noticing index.html is being forced on me as the homepage. As I understand it's good practice to 301 redirect the index.html page to the to the actual home page. Can someone please confirm that I am right in thinking this? Here is an example: http://www.anguilla-beaches.com/index.html
Link Building | | umtmedia
http://www.anguilla-beaches.com/ According to yahoo 773 links are pointing to the index.html page and 771 links are pointing to the / page. I'm sure Google knows that these are the same pages and does not consider them as duplicate but surely the index.html page should be redirected right? am I going mad here? Now if we look at this site: http://www.jugglenow.com the homepage has 198 links according to yahoo
http://www.jugglenow.com/index.html this page also has 198 links? now I am confused, are these 2 the same page? On this page: http://www.jugglenow.com/juggling-balls.html notice how there is no link to the actual homepage but there is a link to the index.html page. Am I missing something here because I can't figure it out, surely there should be just 1 homepage without a index.html page. Any help would be appreciated0 -
Link Location: In main page or inner "Link" page?
My question is what´s best of Link Building: have it in main page or in internal Link Pages. I have the problem that have to reduce the number of outgoing links in my mainpage to rank better, but do not want to miss any linkjuice. How Linking in Main Page or Internal Pages affects SERP for your website? And should they be Follow or not Follow? Thanks in advance Maria Jesus
Link Building | | goperformancelabs0