Drop in Page Indexing, Small rise in Search Queries
-
Hello,
I have a news based website so i am creating multiple new posts daily. I changed a lot of the site and got rid of old potentially duplicate content back in feb and had a sharp drop in pages indexed. I know this was because I removed a lot of pages though. However I still have a good 20,000 + pages on my site and my indexing has dropped a further three times since then. From 9,000 to 2,000 a coupe of months ago and then slowly down since April to just 133.
It doesn't seem to have affected my search queries yet but surely will if it continues.
I am really confused as to how this might happen & how to turn it around. We dont use any dodgy SEO tricks either.
-
So, first off, let me say that this isn't always a bad thing. Less indexed content, if much of your content is duplicated (or nearly duplicated) could actually improve the ranking of the rest of your content. More pages isn't better.
On the other hand, it's one thing when you proactively remove content from the index - it's another when Google does it for you. Are you seeing any patterns? As Chris said, it could be that your internal linking changed, or it could be that Google sees these pages as duplicate or low-quality and has removed them or implicitly canonicalized them (we're seeing more of that - it's like you have a rel=canonical on the page, but you don't). The other issue could be if there are duplicates on other site across the web, causing your copy to be filtered out.
Either way, you have to find out which pages are impacted and figure out the pattern. Do you have XML sitemaps? A well structured set of sitemaps can help you get a better sense of which pages are being indexed.
-
Also would you say it was a good or bad idea to stop tags and archives from being logged on the sitemap in wordpress SEO plug in? This may be an effecting issue?
-
Thanks for your response Chris.
I changed the theme of my site though I did a google search on it and it returned no problems? I have had no messages on my Webmaster tools. I have done a scan with the Screaming Frog (thank you for the suggestions) and a lot of other stuff comes up but not so many of my posts and I have thousands. I am guessing this might be something to do with it - a question - is google unable to access what's in a drop down menu? This might be a problem.
-
There was a rolling update on Google that started in May around the 22nd. You may have been affected. Check your GA to see if any notable activity or decrease happened on that date.
-
Lowhosjack,
If you've dropped from over 20K pages index to 133 without a drop in search traffic it would indicate a few things to me:
1. All of your search traffic is landing on those 133 pages -- Have you looked at your stats history to see that you haven't been receiving traffic from other sources to your site other than to those pages?
2. You changed your architecture or your internal linkingprevious to your drop in indexation.--Other than deleting the duplicate content, did you make any other changes to your site? You can crawl your site to verify Google can reach all of your pages with a tool like screamingfrog or xenu.
3. The content on those pages is low quality--Are you making sure that the content that you create is really worthwhile to your target audience?
If this was penalty related, I would think that the pages bringing in your traffic would be the ones hardest hit, so at this point, it doesn't look like a penalty but you really do need to get in to your stats and take a close look at what's been happening with the stats on those pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Internal pages ranking over the homepage: How to optimise to rank better at Google?
Hi, We have experienced a shift in SERP from internal pages ranking over website homepage for more than a year. Previously website homepages used to rank for the primary keyword like moz.com for "SEO". Now we can see that internal pages like moz.com/learn/seo/what-is-seo been ranking for the primary keyword "SEO". Google is picking up these "what is ABC" pages than the homepage. All our competitor sites are ranking with these internal pages which are about "what is (primary keyword)". We do have the same internal pages "what is....", but this pages is not ranking; only our homepage is ranking. Moreover we dropped more than 15 positions after this shift in SERP. How to diagnose this? Thanks
Algorithm Updates | | vtmoz0 -
Meta robots at every page rather than using robots.txt for blocking crawlers? How they'll get indexed if we block crawlers?
Hi all, The suggestion to use meta robots tag rather than robots.txt file is to make sure the pages do not get indexed if their hyperlinks are available anywhere on the internet. I don't understand how the pages will be indexed if the entire site is blocked? Even though there are page links are available, will Google really index those pages? One of our site got blocked from robots file but internal links are available on internet for years which are not been indexed. So technically robots.txt file is quite enough right? Please clarify and guide me if I'm wrong. Thanks
Algorithm Updates | | vtmoz0 -
More pages or less pages for best SEO practices?
Hi all, I would like to know the community's opinion on this. A website with more pages or less pages will rank better? Websites with more pages have an advantage of more landing pages for targeted keywords. Less pages will have advantage of holding up page rank with limited pages which might impact in better ranking of pages. I know this is highly dependent. I mean to get answers for an ideal website. Thanks,
Algorithm Updates | | vtmoz1 -
Dramatic drop in SEO rankings after recovering from hacking
A few months ago my client's website was hacked which created over 20,000+ spammy links on the site. I dealt with removing the malware and got google to remove the malware warning shortly within a week of the hacking. Then started the long process to do 301 redirects and disavowing links under Webmaster tools over these few months. The hacking only caused a slight drop in rankings at the time. Now just as of last week the site had a dramatic drop in rankings. When doing a keyword search I noticed the homepage doesn't even get listed on Google Maps and for Google Search instead the inner pages like the Contact Us page show up instead of the homepage. Does anyone have any insight to the sudden drop happening now and why the inner pages are ranking higher than the homepage now?
Algorithm Updates | | FPK0 -
In how much time will my search visibility increase?
Hey I really wanna know how much time will take to my search visibility increase!! Thanks
Algorithm Updates | | THOMAZDANDREA10 -
QA for Sitelinks Search Box
hi all, I have added the suggested code to my homepage as follows: This was added 10 days ago. I continue to see on Google SERPs a search box sitelink, but it produces a page of results on a secondary SERP page for my site instead of bringing people directly into my site to the search result page relative to their query. Is there a time lag from the time the code was implemented to when it is functional on Google? Is there any way to QA the code to ensure it works correctly and if Google has yet to include it in their latest cache?
Algorithm Updates | | dsinger0 -
Changing the # of results per page in Google search settings displays totally different results. Why is this?
Curious what's going on here. This is the first time I've seen this before. What's happening is this ... In Google, I search for "mobile apps orange county" and get a standard list of 10 results. I go to Google's search settings in the top right corner of the page (button is grey with a gear) to change the number of results per page from 10 to 50 (also did 100). When I go back to Google and search again for "mobile apps orange county" I get a much larger list but with completely different results. This time around the top 10-12 are dominated by the same website (ocregister.com) What's going on here that Google would now show different results? Why is this one website all of a sudden dominating the first 12 results? Thanks everyone! ByteLaunch
Algorithm Updates | | ByteLaunch0 -
Recent changes to suggested search algorithm?
Our company recently had a "company name + scam" listing as #2 in suggested search, and yesterday, it miraculously disappeared. Has anyone else noticed similar changes in suggested search results? I hope it stick, I'm just trying to understand exactly what caused that 1 listing to vanish.
Algorithm Updates | | CareerBliss0