Drastic increase of indexed pages correlated to rankings loss?
-
Our ecommerce website has had a drastic increase in indexed pages, and equal loss of Google organic traffic. After 10/1 the number of indexed pages jumped from 240k to 5.7 million by the end of the year, according to GWT. Coincidentally, the sitemap tops at 14,192 pages, with 13,324 indexed. Organic traffic on some top keyphrases began declining by half after 10/26 and ranking (previously placing in the top 5 spots) has dropped to the fifth page of results.
This website does produce session id's (/c=) so we been blocking /c=/ in the robots.txt file. We also have a rel=canonical on all pages pointing at the correct url. With all of this in place, traffic hasn't recovered.
Is there a correlation between this spike of indexed pages and the lost keyword ranking? Any advice to investigate and correct this further would be greatly appreciated.
Thanks.
-
Thanks for your response Irving Weiss. Our webmaster made a couple of changes since this post, which I'll list at the end. First
a) Prior, the robots.txt file was..
User-agent: *
Robot-version: 2.0.0
Crawl-delay: 2
Request-rate: 1/4*
Sitemap: http://www.888knivesrus.com/sitemap.xml
Disallow: /c=/b) No and unfortunately the edit/add button is missing from the parameters section in our account.
c) not that we've found
d) It dropped from 5.7 to 5 million on 1/1, and has remained there.Some updates:
Our webmaster made a couple of changes yesterday to address this issue. Some of research we found said blocking the session id parameter in robots.txt file was preventing Googlebot from seeing the rel=canonical in place and it should be removed. They made an update to the robots.txt removing it. An x-robots tags of noindex and nosnippet was also added to the pagesThe webaddress is www.888knivesrus.com
Thanks again!
-
Yes they are absolutely related. you want from 240k pages to 5,700,000 pages of empty or dupe content, so Google thinks you're spamming them.
a) are you sure you correctly blocked everything
b) have you added the session IDs to WMT in the parameter handling section?
c) are there any technical issues such as incorrect pagination of pages, or pages not 404'ing when they should?
Finally, Have you seen the pages indexed number begin to drop yet?
If we had the URL we could poke around a bit for you
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Page Indexing without content
Hello. I have a problem of page indexing without content. I have website in 3 different languages and 2 of the pages are indexing just fine, but one language page (the most important one) is indexing without content. When searching using site: page comes up, but when searching unique keywords for which I should rank 100% nothing comes up. This page was indexing just fine and the problem arose couple of days ago after google update finished. Looking further, the problem is language related and every page in the given language that is newly indexed has this problem, while pages that were last crawled around one week ago are just fine. Has anyone ran into this type of problem?
Technical SEO | | AtuliSulava1 -
A new client has image urls showing above their page rankings for the same key phrase.
New client website https://yorkshirefoodguide.co.uk/ has for some key phrase searches the URL for an image showing above or as well as the url for the landing page. I'd be happy for it to show in the image pack but I want to url to rank in the main serp. The site is in WordPress and I'm sure this is just a setting I need to manage. Can you help please?
Technical SEO | | Marketing_Optimist0 -
If the order of products on a page changes each time the page is loaded, does this have a negative effect on the SEO of those pages?
Hello, a client of mine has a number of category pages that each have a list of products. Each time the page is reloaded the order of those products changes. Does this have a negative effect on the pages' rankings? Thank you
Technical SEO | | Kerry_Jones2 -
Page titles in browser not matching WP page title
I have an issue with a few page titles not matching the title I have In WordPress. I have 2 pages, blog & creative gallery, that show the homepage title, which is causing duplicate title errors. This has been going on for 5 weeks, so its not an a crawl issue. Any ideas what could cause this? To clarify, I have the page title set in WP, and I checked "Disable PSP title format on this page/post:"...but this page is still showing the homepage title. Is there an additional title setting for a page in WP?
Technical SEO | | Branden_S0 -
Odd Ranking Page - Contact Us
Hi Everyone, So I have a client and when they are logged in the "Contact Us" page ranks as the number 1 page. She sends me screenshots when she is looked in through the corporate Google account, in a panic because of this...I am guessing she is frequently visiting the contact us page while logged in, which is why this is happening but I can't think of any other reason. From a ranking factors perspective there aren't any reasons for this. There are barely any links pointing to this page. I just don't know what to tell her. I can't duplicate it.
Technical SEO | | runnerkik0 -
Web page is showing up on Google but doesn't show when it was cached, so is it indexed?
Hey everyone So I created a new page on a WordPress website, it was live for a few hours till I changed my mind & switched it back to a draft. Just out of curiosity I did the Site:www.example.com/Example search on Google to see if it had been indexed & apparently it had but when I click on cached to see what time it got indexed at exactly it's showing me an error. So does this mean it is indexed or not?
Technical SEO | | conversiontactics0 -
Viral page not ranking onGoogle
A user generated talk thread on our social networking site went viral yesterday and generated around 36000 extra visits. But, when we Google the key phrase in this thread our site is not even in the Top 50. Instead the pages are dominated by other (lesser) websites referring to the content and linking to the thread The page is indexed The on page SEO grade for the key phrase and variant according to SEOMoz is A Our home page has a PR of 7 and an SEO Domain Authority of 76 We are the original source of this content Other talk threads on different subjects in a similar category are ranking on page 1 of Google. What's happening?
Technical SEO | | CecilyP0 -
Lost ranking once optimised a page
Hello, we're a new member of SEOMOZ and love it but have a problem. Obviously the reason for joining is to learn more about SEO and hopefully get our website ranked a lot better than it currently is. However, one particular page we've chosen to optimise (based on your tips) has since lost ranking and we can no longer find it in the searches. Is there a reason for this? We've only made the on page changes you suggested and also added more external and internal links so I can't understand why it would no longer be listed in the searches? I look forward to your reply/feedback. Many thanks Peter
Technical SEO | | mybabyradio0