Drop in Page Indexing, Small rise in Search Queries
-
Hello,
I have a news based website so i am creating multiple new posts daily. I changed a lot of the site and got rid of old potentially duplicate content back in feb and had a sharp drop in pages indexed. I know this was because I removed a lot of pages though. However I still have a good 20,000 + pages on my site and my indexing has dropped a further three times since then. From 9,000 to 2,000 a coupe of months ago and then slowly down since April to just 133.
It doesn't seem to have affected my search queries yet but surely will if it continues.
I am really confused as to how this might happen & how to turn it around. We dont use any dodgy SEO tricks either.
-
So, first off, let me say that this isn't always a bad thing. Less indexed content, if much of your content is duplicated (or nearly duplicated) could actually improve the ranking of the rest of your content. More pages isn't better.
On the other hand, it's one thing when you proactively remove content from the index - it's another when Google does it for you. Are you seeing any patterns? As Chris said, it could be that your internal linking changed, or it could be that Google sees these pages as duplicate or low-quality and has removed them or implicitly canonicalized them (we're seeing more of that - it's like you have a rel=canonical on the page, but you don't). The other issue could be if there are duplicates on other site across the web, causing your copy to be filtered out.
Either way, you have to find out which pages are impacted and figure out the pattern. Do you have XML sitemaps? A well structured set of sitemaps can help you get a better sense of which pages are being indexed.
-
Also would you say it was a good or bad idea to stop tags and archives from being logged on the sitemap in wordpress SEO plug in? This may be an effecting issue?
-
Thanks for your response Chris.
I changed the theme of my site though I did a google search on it and it returned no problems? I have had no messages on my Webmaster tools. I have done a scan with the Screaming Frog (thank you for the suggestions) and a lot of other stuff comes up but not so many of my posts and I have thousands. I am guessing this might be something to do with it - a question - is google unable to access what's in a drop down menu? This might be a problem.
-
There was a rolling update on Google that started in May around the 22nd. You may have been affected. Check your GA to see if any notable activity or decrease happened on that date.
-
Lowhosjack,
If you've dropped from over 20K pages index to 133 without a drop in search traffic it would indicate a few things to me:
1. All of your search traffic is landing on those 133 pages -- Have you looked at your stats history to see that you haven't been receiving traffic from other sources to your site other than to those pages?
2. You changed your architecture or your internal linkingprevious to your drop in indexation.--Other than deleting the duplicate content, did you make any other changes to your site? You can crawl your site to verify Google can reach all of your pages with a tool like screamingfrog or xenu.
3. The content on those pages is low quality--Are you making sure that the content that you create is really worthwhile to your target audience?
If this was penalty related, I would think that the pages bringing in your traffic would be the ones hardest hit, so at this point, it doesn't look like a penalty but you really do need to get in to your stats and take a close look at what's been happening with the stats on those pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Confuse search engine result
When We check few keywords in Google.com from India, we can see these keywords perfectly listed in the first google search result pages. But when I checked these keywords in USA chorme, Mozilla, internet explorer Brower using one of our USA client pc using remote desktop, we really shocked that these keywords not listed in the USA country. Which means I am an Indian, if I check these keywords from India using google.com, I can see but if I check these keywords in USA country PC browser, I do not see. Please help us
Algorithm Updates | | Intellect0 -
Search traffic plummeting after HTTPS fumble - what to do now?
Hi all, Our website typically gets about 80% of our traffic from organic Google search over thousands of keywords (i.e., no single keyword (or group of) drives a large portion of our traffic). It's a nine year old website, and we have been growing steadily -- including about 30-40% year-over-year growth for the past 9-months. That is, up until Feb 2nd. On February 2nd, we switched to HTTPS. Everything was done per Google's recommendations: pages individually 301'd to HTTPS pages, no security warnings, added the new site in Webmaster Tools, etc. Google started to pick up our new site -- albeit 3 weeks into the transition, traffic was still significantly down. However, the big problem that we discovered was our ad revenues were getting destroyed. We're an ad based business and our CPMs were tanking, some of our ad partners were having problems serving ads, etc. We were losing a lot of money. So, we made the decision to reverse the HTTPS change and go back to HTTP. That was on Feb 22nd. Our traffic started to recover, and our ad rates did recover. However, 2-weeks after switching back -- March 8 -- our traffic started to fall and has continued to do so. Our traffic is now half of what it was a year ago, and only 1/3 of what it was before we made any changes. I am totally at a loss for what to do. I have spent endless hours digging through Webmaster Tools with no real insights. Here's the most I've been able to glean: Google picked up the new HTTPS site a lot faster than it has reverted back to the HTTP. Particularly for AMP pages. We had about 2,000 indexed AMP pages, which were quickly picked up when we switched to HTTPS, but since changing back to HTTP Google has been slow to re-index the HTTP. Only 935 AMP indexed pages now. According to Webmaster Tools, our overall ranking position has not been affected (the overall average). However, in a sampling of keywords I notice that a number of keywords seem to have been dropped completely from ranking, while others show the same rank position but Google seems to only be showing us in the results intermittently -- e.g., rank is unchanged, but impressions and clicks are much lower. I do not know what to do at this point, and sadly, I'm starting to get desperate for some help. I feel like all the hard work of almost a decade is slipping away and I have no idea how to change course. I've done absolutely everything I can think of from a technical standpoint. Am I being penalized for abandoning the switch to HTTPS? Should I now try and reverse course again, and switch BACK to HTTPS? Is this a temporary bobble that Google's algo will 'forget'? It's a super high quality website with long, unique, detailed articles. Not spammy and we have never had a manual action against us. I don't know what to do. Please help! Here's a link to the website. Thank you in advance.
Algorithm Updates | | tustind0 -
Flux in Bing/Yahoo search rankings?
Has anyone else noticed any flux in Bing/Yahoo desktop search rankings in the start of March? Our weekly MSN search traffic was steady and then starting dropping off around March 3 or 4. Weekly desktop traffic now down about 20% Anyone see anything similar or have any resources for learning more about this?
Algorithm Updates | | ted-zarceczny0 -
Search Bar Under Brand In Search Result
I must have missed this or been living under a rock but when I type 'amazon' in a google search. Below Amazon.com I see a "search amazon.com" search bar. How do you get this? Thanks
Algorithm Updates | | Mike.NW1 -
Rankings fluctuating by around 10 pages between night and day
Hi all, I'm experiencing something very odd with my website ranking at the moment. My homepage is fluctuating in rank for my main keyword by 10 pages every day and night. So, during the day i am on page 14, 15 or 16 for my main keyword yet by night i am on page 5 or 6. This trend has continued for the past 7 days now and i can't quite understand why this is. I'm using pagewash dot net to carry out manual searches and a ranking tool - both of which produce exactly the same result. Does anyone have any experience of this or why this is happening? My domain is around 8 years old and has around 50,000 pages. Any pointers would be greatly appreciated.
Algorithm Updates | | MarkHincks0 -
A Serious drop in Pages crawled per day
On 21st April ,I spotted a sudden decrease in pages crawled per day.Previously it was about 5,000 bust after the drop it reached to 225.From the crawl rate never spiked. Here is my website url - http://www.wpstuffs.com/ 8fQHW2G.png
Algorithm Updates | | vividvilla0 -
Did anyone else notice a DA Drop this week?
I have our site + 4 other competitors' sites in my SEOmoz campaigns and all of the DA's dropped by 1 or 2 points. Has anyone else noticed a drop this week? Two months ago, all of these websites also went down 1 or 2 DA points, then some of them came back up a point the next month. What's going on? Thanks
Algorithm Updates | | pbhatt0 -
Large number of thin content pages indexed, affect overall site performance?
Hello Community, Question on negative impact of many virtually identical calendar pages indexed. We have a site that is a b2b software product. There are about 150 product-related pages, and another 1,200 or so short articles on industry related topics. In addition, we recently (~4 months ago) had Google index a large number of calendar pages used for webinar schedules. This boosted the indexed pages number shown in Webmaster tools to about 54,000. Since then, we "no-followed" the links on the calendar pages that allow you to view future months, and added "no-index" meta tags to all future month pages (beyond 6 months out). Our number of pages indexed value seems to be dropping, and is now down to 26,000. When you look at Google's report showing pages appearing in response to search queries, a more normal 890 pages appear. Very few calendar pages show up in this report. So, the question that has been raised is: Does a large number of pages in a search index with very thin content (basically blank calendar months) hurt the overall site? One person at the company said that because Panda/Penguin targeted thin-content sites that these pages would cause the performance of this site to drop as well. Thanks for your feedback. Chris
Algorithm Updates | | cogbox0