Drop in Indexed Page + Organic Traffic
-
Hey Moz Community,
I've been seeing a steady decrease in search console of pages being indexed by Google for our eCommerce site. This is corresponding to lower impressions and traffic in general this year. We started with around a million pages being indexed in Nov of 2015 down to 18,000 pages this Nov. I realized that since we don't have around 3,000 or so products year round this is mostly likely a good thing.
I've checked to make sure our main landing pages are being indexed which they are and our sitemap was updated several times this year, although we're in the process of updating it again to resubmit. I also checked our robots.txt and there's nothing out of the ordinary. In the last month we've recently gotten rid of some duplicate content issues caused by pagination by using canonical tags but that's all we've done to reduce the number of pages crawled. We have seen some soft 404's and some server errors coming up in our crawl error report that we've either fixed or are trying to fix.
Not really sure where to start looking to find a solution to the problem or if it's even a huge issue, but the drop in traffic is also not great. The drop in traffic corresponded to lose in rankings as well so there could be correlation or none.
Any ideas here?
-
Oops, I missed that part. Have you checked Google Search Console to see if someone set any URL parameters?
The first thing I would do is determine how many pages actually should be indexed to see if there's a large discrepancy between that and the number Google shows. A crawler like Screaming Frog can help with this. If you export the crawl to Excel, you can easily remove duplicates in the canonical URL column and filter out the noindexed pages.
If you find there's no real discrepancy, Google may have simply been cleaning house of some really old links in the index that hadn't been crawled in a while.
Beyond that, if you can pinpoint any specific URLs that have been deindexed, use the "Fetch as Google" tool to help diagnose or post it here so the community can take a look.
-
Hi Laura,
Thanks for your response, I know that adding canonical tags can lower our indexed pages count. The only thing I'm worried about is the fact that the drop in indexed pages have been steady since Nov of last year and we just implemented the tags last month.
We have been seeing lower conversions with less traffic some of which has to do with us not ranking as well for a few key-terms as we did last year.
-
I suspect the canonical tag implementation is the culprit for the loss in indexed pages, but that's just a strong suspicion. When you implement a canonical tag, Google will fold together all of the pages pointing to the same canonical URL so that they are treated as one URL for the purposes of indexation. This will naturally cause a reduction in the overall number of pages indexed. You won't see 404 errors as a result of this either.
One important point to remember is that a decrease in indexed pages is not necessarily a bad thing that needs to be fixed. In fact, if you were having problems with duplicate content or crawl issues, canonicalizing those URLs should be beneficial if properly implemented.
As for the loss in traffic, it could be related or not. It may just be an adjustment period from the canonicalization, or it could a separate issue. Have you seen a corresponding loss in conversions?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Specific pages won't index
I have a few pages on my site that Google won't index, and I can't understand why. I've looked into possible issues with Robots, noindex, redirects, canonicals, and Search Console rules. I've got nothing. Example: I want this page to index https://tour.franchisebusinessreview.com/services/franchisee-satisfaction-surveys/ When I Google the full URL, I get results including the non-subdomain homepage, and various pages on the subdomain, including a child page of the page I want, but not the page itself. Any ideas? Thanks for the help!
Technical SEO | | ericstites0 -
Duplicate page titles for blog snippets pages
I can't figure the answer to this issue, on my blog I have a number of pages which each show snippets and an image for each blog entry, these are called /recent-weddings/page/1 /2 /3 and so on. I'm getting duplicate page titles for these but can't find anywhere on Wordpress to set a unique title for them. So http://www.weddingphotojournalist.co.uk/recent-weddings/…/2/ has the same title as http://www.weddingphotojournalist.co.uk/recent-weddings/…/3/
Technical SEO | | simonatkinsphoto0 -
Help. Recently my organic traffic has dropped 40%. Any advice / ideas?
Lately my organic traffic has dropped significantly as well as my adsense revenue. The moz report says, for example, my traffic is down 40%, but I a still #1 for that keyword. Also, in the last week, suddenly my number of indexed pages doubled. We had done some page rewriting and maybe messed that up. We've fixed that though. Webmaster tools is still picking up all of our old pages and the new ones. Background: We recently launched our new responsive website in March. March income was about the same as February. April dropped off suddenly (maybe late march - no sure) When we changed site, we did do 301's for all the old pages to the new ones Any ideas or advice as to why my traffic and revenue has dropped off so sharply? Never submitted questions before - not sure if I am supposed to put urls here so if you just google Home Spelling Words - that's my website. Thanks everyone!!!
Technical SEO | | kimtastic0 -
Page not indexed but still has a PageRank, how?
http://www.optiproerp.com/products.aspx page is not indexed in Google but still has a PageRank of 1. How? Regards
Technical SEO | | IM_Learner0 -
(updated) Huge Drop in Traffic Related to DMCA...?
(update: How would I know if someone has filed a DMCA Takedown Request? There is no message on Webmaster Tools. The reason I ask is because a few months back my client's old SEO threatened him with copyright infringement, and I believe the date of the threatening letter coincides with our drop in traffic. Coincidence?) We've been increasing traffic for a pest control client on a very consistent basis throughout the year. However, in October we noticed a drop but I honestly didn't dig too deeply into the issue. In November we saw another drop...a very large drop...in traffic. Since September, we've lost 50% of search traffic. We've lost specifically branded search traffic, which baffles me. What are some reasons for losing branded search traffic? I've consulted the client and asked if there is anything happening within the business that I should know about, but things seem to pretty normal as far as he can tell. We are also losing rankings dramatically. We've had two locations on Google Places pending for over a month, which I've consulted Google about but, of course, have received no response. The strangest part is that SEOMoz is showing our errors on site have increased dramatically, when we have done nothing new or different over these past few months. It's been business as usual, and yet we are losing traffic, rankings, and errors have gone up. Any ideas would be greatly appreciated! http://www.MagicPest.com Thank you!
Technical SEO | | Linwright0 -
Page rank 2 for home page, 3 for service pages
Hey guys, I have noticed with one of our new sites, the home page is showing page rank two, whereas 2 of the internal service pages are showing as 3. I have checked with both open site explorer and yahoo back links and there are by far more links to the home page. All quality and relevant directory submissions and blog comments. The site is only 4 months old, I wonder if anyone can shed any light on the fact 2 of the lesser linked pages are showing higher PR? Thanks 🙂
Technical SEO | | Nextman0 -
New Domain Page 7 Google but Page 1 Bing & Yahoo
Hi just wondered what other people's experience is with a new domain. Basically have a client with a domain registered end of May this year, so less than 3 months old! The site ranks for his keyword choice (not very competitive), which is in the domain name. For me I'm not at all surprised with Google's low ranking after such a short period but quite surprsied to see it ranking page 1 on Bing and Yahoo. No seo work has been done yet and there are no inbound links. Anyone else have experience of this? Should I be surprised or is that normal in the other two search engines? Thanks in advance Trevor
Technical SEO | | TrevorJones0 -
Backlinks to home page vs internal page
Hello, What is the point of getting a large amount of backlinks to internal pages of an ecommerce site? Although it would be great to make your articles (for example) strong, isn't it more important to build up the strength of the home page. All of My SEO has had a long term goal of strengthening the home page, with just enough backlinks to internal pages to have balance, which is happening naturally. The home page of our main site is what comes up on tons of our keyword searches since it is so strong. Please let me know why so much effort is put into getting backlinks to internal pages. Thank you,
Technical SEO | | BobGW0