Drop in indexation but increase in organic traffic
-
We've had a puzzling drop in indexed pages on our ecommerce website. My crawl returns just over 25k items. Until 19/6 we had about 23-24k indexed. Then we experienced a sudden drop from 19/6 to 26/6: from 23,400 to 18,999, losing 4.4k pages from one week to the next.
At the same time, our organic traffic has not decreased, it actually increased, however, it's only been a couple of weeks so that may be coincidence.
A few things that have happened during the past few weeks:
- 31/5: we implemented pagination on category pages to avoid issues with duplicate content - could it be that this led to a decrease in indexed pages 3 weeks later? However, I can only find about 1.5k pages in my crawl that are page 2+
- 18-19/6: we had some website outages over the weekend; as a B2B business, we don't get much traffic over the weekend, so I can't see an impact to traffic. However, the following week, indexation dropped by another 250 (then stayed the same this past week), so I don't think this was a factor.
- 21/6: we retired another website and migrated it to our main website. However, all pages were redirected to existing pages so no new pages were created for the migration. This doesn't really explain a decrease in indexation, but may account for some of the increase in organic traffic; however not all as the retired website hardly got any organic traffic.
So, should we be worried? As our website is quite large, it would probably be quite difficult to pin point exactly which pages dropped off the index, but a loss of 19% of pages is quite significant. Then again, it doesn't appear to have negatively impacted organic traffic...
Have you got any suggestions for what I should be looking at to find out what happened? Should I be worried at this point? I will definitely continue to have an eye on how our organic traffic (and indexation) develops but I am not sure if there is anything I can do at this point.
I'd appreciate your advice on this, to make sure I am not missing something blindingly obvious. Thanks!
-
Hi Marcus,
Thanks for the comprehensive answer.
I don't have an exact number of products on our website due to how they are added; we have some products that are parent products consisting of several child products, so it is one product page but several product records.
Our sitemaps list just over 18k pages total - 17.3 product pages, 650 categories and the remainder are other content - however, it lists parent and child products (where child products redirect to parent products). So that number and the number of pages indexed by Google actually match very closely (Google have 18.7k indexed pages).
The crawl finds only 9.5k product pages as it doesn't list the child product pages, just parent product pages. It finds 2.1k category pages (including pages 2+, which are not included in the sitemap) and a similar number of other content compared to the sitemap.
I know that we have some problems with duplicate content as some products are very similar - we are working on addressing this as far as possible but it is a long-term project and, as you can imagine, it will take a while. Unfortunately our back end doesn't allow us to combine into one parent product where a product comes in a different size and in different colours, for example. In this case, we can combine into a parent product all different colours but we will have e.g. 10 different products for the different sizes. Changing the product description here doesn't seem user-friendly (even though it may make sense for SEO purposes) so for now, they will stay as they are. I also know we have some older products which need to be combined into parent and child products but aren't at the moment.
We are already using canonical tags - but these have been in place for a while. No directives have been updated that could affect how the Googlebot crawls our website. We have implemented a small (under 100) number of 301 redirects for category pages. But otherwise the main change recently has been the pagination for categories and the website migration.
I will have a closer look at how our organic landing pages perform and keep an eye on it, but you are right, there are too many possible factors and it may simply Google weeding out old / bad content, which wasn't getting any organic traffic anyway.
Thanks again for the detailed reply.
-
Hey
Very hard to respond to a question like this in general terms. It really needs a careful analysis of the analytics data. Also, we have a lot of moving parts here. Whilst it is tempting to assign the result to one of these changes it simply may not be the case.
With larger ecommerce sites like this we often have lots of pages that are just not that great. It could be that Google is culling some of these older / thinner / weaker pages and you are seeing improved results from what remains.
It could be that you are seeing the benefit of the increased domain authority from folding in this new site and the indexation drop is a red herring.
It could be that some of that 25k pages were not great pages or were even URL based duplicate content. Have you done anything else with directives or canonicals etc?
I would always like to know a few things to double check the figures here:
You could cross reference like by product - how many products are there? If you can answer this you can get a better idea of how many pages there should be rather than just relying on a head count from a large site crawl. If you find out there are only 12k products and a 25k crawl then odds are there is something on the URL based duplication front that needs investigating.
You can also compare the landing pages to see which pages have experienced a drop. It could be the pages that have been culled did no organic search traffic anyway.
Ultimately - I doubt there is much to worry about but I would want to get a headcount on products, types of pages, quality of pages etc as it could be a sign that some of your pages need improving.
To answer beyond that would need a look at the site and the analytics.
Hope that helps!
Marcus
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Slow growth in organic traffic
Hi, Recently our website after 5 months of launch started seeing more organic traffic, thanks to the seo effort being put. However, off late the growth is quite slow and we don't see much increase in organic traffic any more. Any idea on what could have happened to cause this or is it normal. Here is the link to the website to check and if you can recommend anything - https://www.keyhub.com Thanks, Search-Console-Search-Analytics-https-www-keyhub-com-1.png
Reporting & Analytics | | kh-priyam1 -
Sudden Drop in Index Status on GSC
Hi all, We've seen a sudden drop in index status on GSC from 19,000 to 12,000. Rankings, referring domains, organic traffic etc. have not changed. However, we have implemented a huge number of redirects and done a site migration from http to https in the past year. Could this have an effect? Thanks!
Reporting & Analytics | | SMVSEO0 -
Increase of direct traffic
Hi everyone, We have a weird issue in our Google Analytics account. We have enormous amount of direct traffic, but not to our homepage, but to blogs that are published and posted to facebook. e.g. yesterday we did a post and it received 3.500 visits of which 2.900 were direct.
Reporting & Analytics | | Loui-60570
I'm unable to figure out how this is possible. 90% of the direct traffic comes from mobile phones Anyone has an idea?0 -
Getting google impressions for a site not in the index...
Hi all Wondering if i could pick the brains of those wise than myself... my client has an https website with tons of pages indexed and all ranking well, however somehow they managed to also set their server up so that non https versions of the pages were getting indexed and thus we had the same page indexed twice in the engine but on slightly different urls (it uses a cms so all the internal links are relative too). The non https is mainly used as a dev testing environment. Upon seeing this we did a google remove request in WMT, and added noindex in the robots and that saw the index pages drop over night. See image 1. However, the site still appears to getting return for a couple of 100 searches a day! The main site gets about 25,000 impressions so it's way down but i'm puzzled as to how a site which has been blocked can appear for that many searches and if we are still liable for duplicate content issues. Any thoughts are most welcome. Sorry, I am unable to share the site name i'm afraid. Client is very strict on this. Thanks, Carl image1.png
Reporting & Analytics | | carl_daedricdigital0 -
Spike in Direct visits with Drop in Google Organic Visits
Does anyone have an explanation for why Google organic visits plummeted while direct visits rose the same amount. Total visits have been very normal. jI1Bn2B,UuzONNK kepV0eu
Reporting & Analytics | | phogan0 -
Does this traffic drop look like Penguin to you?
Dear Community In early October, I noticed a sharp drop of the rankings of the main KW of a website I manage: idee-sol.fr. This, of course I immediatelly attributed to penguin 2.1. While researching on the experience other webmasters have had with this unfortunate situation, I noticed that most of them had very sharp drops of traffic in a relatively small time, e.g.: a drop of 80% in a couple of days. But on idee-sol, the drop looks less steep yet equally worrying. Was the cause of this traffic/ranking drop due to penguin 2.1 exclusively or to penguin + something else (or not penguin at all?) I'm including an image of the "non paid search" report of analytics. dPnphnr
Reporting & Analytics | | Masoko-T0 -
Direct Traffic Spike
In February, I transferred an HTML site to a WordPress Platform. Since then, Direct traffic has spiked to nearly 400% since the WordPress transition. The Direct traffic spike took roughly 2 months before it started to kick in. Does anyone know what this could be attributed to?
Reporting & Analytics | | SteveZero120 -
How to devide Google traffic into local google traffic (.com , .uk , .cn etc) in Analytics
Hi, friends In google analytics , we can see search traffic from google, but is it possible to deeply see from which local google? eg: .com , .uk, .hk etc? Thanks alots
Reporting & Analytics | | topchinaseo
Boson0