Drop in Page Indexing, Small rise in Search Queries
-
Hello,
I have a news based website so i am creating multiple new posts daily. I changed a lot of the site and got rid of old potentially duplicate content back in feb and had a sharp drop in pages indexed. I know this was because I removed a lot of pages though. However I still have a good 20,000 + pages on my site and my indexing has dropped a further three times since then. From 9,000 to 2,000 a coupe of months ago and then slowly down since April to just 133.
It doesn't seem to have affected my search queries yet but surely will if it continues.
I am really confused as to how this might happen & how to turn it around. We dont use any dodgy SEO tricks either.
-
So, first off, let me say that this isn't always a bad thing. Less indexed content, if much of your content is duplicated (or nearly duplicated) could actually improve the ranking of the rest of your content. More pages isn't better.
On the other hand, it's one thing when you proactively remove content from the index - it's another when Google does it for you. Are you seeing any patterns? As Chris said, it could be that your internal linking changed, or it could be that Google sees these pages as duplicate or low-quality and has removed them or implicitly canonicalized them (we're seeing more of that - it's like you have a rel=canonical on the page, but you don't). The other issue could be if there are duplicates on other site across the web, causing your copy to be filtered out.
Either way, you have to find out which pages are impacted and figure out the pattern. Do you have XML sitemaps? A well structured set of sitemaps can help you get a better sense of which pages are being indexed.
-
Also would you say it was a good or bad idea to stop tags and archives from being logged on the sitemap in wordpress SEO plug in? This may be an effecting issue?
-
Thanks for your response Chris.
I changed the theme of my site though I did a google search on it and it returned no problems? I have had no messages on my Webmaster tools. I have done a scan with the Screaming Frog (thank you for the suggestions) and a lot of other stuff comes up but not so many of my posts and I have thousands. I am guessing this might be something to do with it - a question - is google unable to access what's in a drop down menu? This might be a problem.
-
There was a rolling update on Google that started in May around the 22nd. You may have been affected. Check your GA to see if any notable activity or decrease happened on that date.
-
Lowhosjack,
If you've dropped from over 20K pages index to 133 without a drop in search traffic it would indicate a few things to me:
1. All of your search traffic is landing on those 133 pages -- Have you looked at your stats history to see that you haven't been receiving traffic from other sources to your site other than to those pages?
2. You changed your architecture or your internal linkingprevious to your drop in indexation.--Other than deleting the duplicate content, did you make any other changes to your site? You can crawl your site to verify Google can reach all of your pages with a tool like screamingfrog or xenu.
3. The content on those pages is low quality--Are you making sure that the content that you create is really worthwhile to your target audience?
If this was penalty related, I would think that the pages bringing in your traffic would be the ones hardest hit, so at this point, it doesn't look like a penalty but you really do need to get in to your stats and take a close look at what's been happening with the stats on those pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
PDFs With No Index Contribute To Page Ranks?
I have a question I'm hoping you can help me with. If I upload a PDF and add a no index under the meta robots index so that the PDF doesn't appear in search results when I send people the link to this PDF, does it still contribute to my site traffic/ranking etc? Basically we are deciding whether to put some PDFs with pricing options etc onto our website or on a google drive. We will be sending the links to potential clients. If visitors clicking on the link would still help with increasing traffic and increasing our google rank (without that PDF showing in results) we thought this might be the best solution.
Algorithm Updates | | whiterabbitnz0 -
Still no good search results after 2 months of indexation
Hi guys, One of our website (https://www.residentiebosrand.be/) has been online for about two months. It's indexed and Google shows search results. But the website is not ranking on the keywords it's supposed to be ranking: 'residentie bosrand'. How come we still don't find the website on the first pages in the search results, while these are the main keywords on the website's URL, page, ... ? Best regards,
Algorithm Updates | | conversal0 -
Recent Rank drop after Penguin 2.1?
Recently, a lot of pages from our website have moved from page one or ranking number one, to page ten or something. We got a manual penalty message from Google Team, we removed a lot of unnatural links pointing to our pages and disavowed the rest. This got the penalty removed and we got a message from Google confirming the same. Before the manual penalty we were getting about 140,000 visits per day, after the penalty about 80,000. However, after Hummingbird or Penguin 2.1 all our ranks have vanished. We are nowhere in Google for our primary keywords and we getting like 40,000 visits per day. Most are direct or from sources other than Google. We had another look at the links we disavowed, a list of about 11000 domains, we found about 3000 domains to be good. We fixed the disavow file about one week back, but no changes in traffic since. We checking the domains again to see if we have missed more good domains in there; yes, we have. There are still a very few good domains in there. But we are not touching the disavow list; waiting to see the change for the last submitted. We have a dedicated user base, good liking on Facebook, all the stats in Analytics speak good, about 40% repeat visits about 30% direct. About 3000 people search for the site using our brand name as reported in Analytics. I doubt the on-page optimization, the pages could be over-optimized. But the on-page factors for other pages ranking for the keywords are similar. The keyword density is similar, so are the usage of headings and stuff. We have not made any recent changes to these on-page patterns. Our team is not able to figure out what could have gone wrong.
Algorithm Updates | | Develop410 -
Sudden drop after 301 redirection
Hi Experts We did a 301 redirect from an old site to a new site to get rid of any bad link juice. We recently found a big drop in rankings and traffic after google last indexed the new web pages. We did 301 using asp at page level coding. The website had 4000 approx. pages and we did 301 section by section. This is how we did as per one of the blog post in seomoz. Create a sitemap for your old domain. Create content (contact information, description of your company, indication of future plans) and something link worthy for the new domain. (You should start trying to build links early) Setup the new domain and make it live. Register and verify your old domain and new domain with Google Webmaster Tools. Create a custom 404 page for old domain which suggests visiting new domain. Old Domain error checking and fixing In a development environment, test the redirects from the old domain to the new domain. Ideally, this will be a 1:1 redirect. (www.example-old-site.com/category/sexy-mustaches.html to www.example-new-site.com/category/sexy-mustaches.html) 301 redirect your old domain to your new domain. Submit your old sitemap to Google and Bing. The submission pages are within Google Webmaster Tools and Bing Webmaster Center (This step will make the engines crawl your old URLs, see that they are 301 redirects and change their index accordingly.) Fill out the Change of Address form in Google Webmaster Tools. Create a new sitemap and submit it to the engines. (This will tell them about any new URLs that were not present on the old domain) Wait until Google Webmaster Tools updates and fix any errors it is indicated in the Diagnostics section. Monitor search engine results to make sure new domain is being properly indexed. We also did a press release with prweb to announce the new launch. We followed the steps recommended in one of the I am not sure what to do next. Can anyone suggest if its normal to see a drop and we should wait for some time or if we did something wrong? We are loosing business with every single day. Please help !
Algorithm Updates | | ITRIX0 -
Why do in-site search result pages rank better than my product pages?
Maybe this is a common SERP for a generic product type but I'm seeing it a lot more often. Here is an example SERP "rolling stools". The top 4 results are dynamic in-site search pages from Sears, ebay and Amazon (among others). I understand their influence and authority but why would a search return a dynamic in-site SERP instead of a solid product page. A better question would be - How do I get my in-site SERPs to rank or how do I get my client's page to rise above the #5 spot is currently ranks at? Thanks
Algorithm Updates | | BenRWoodard0 -
Webmaster Tools Crawl Stats Drop - Ranks Dropped too
Hello, So I have a situation I haven't seen that happened today. I checked in on my keyword rankings, and all seemed to drop off the rankings in one day. Even googling my domain name, I'm not the first result (when I always have been with multiple sublinks under). There were no unusual errors in the webmaster tools, no issues "Fetching as Google". The only thing I can find is in Crawl Stats, my "Kilobytes downloaded per day" and "Time spent downloading a page (in milliseconds)" dropped a lot in the last day or so (by about 90%). Has anyone had this happen? Any ideas for how to bounce back from this? Domain referenced is mediamegamall.com Thanks!
Algorithm Updates | | Ask_MMM0 -
How do I rank multiple pages for my busness/domain name?
When someone searches for our business's name (which is also the domain name) we have one listing (with sitelinks) at the top - however I would also like to rank 2nd, 3rd and 4th for this term. Any suggestions on how this might be done? Thanks.
Algorithm Updates | | CaBStudios0 -
Bing Traffic drop
Anyone notice a drop in Bing traffic on January 26th? Slashed by 50% and holding for the past three weeks. 100% white hat site
Algorithm Updates | | loopyal0