Drop in Page Indexing, Small rise in Search Queries
-
Hello,
I have a news based website so i am creating multiple new posts daily. I changed a lot of the site and got rid of old potentially duplicate content back in feb and had a sharp drop in pages indexed. I know this was because I removed a lot of pages though. However I still have a good 20,000 + pages on my site and my indexing has dropped a further three times since then. From 9,000 to 2,000 a coupe of months ago and then slowly down since April to just 133.
It doesn't seem to have affected my search queries yet but surely will if it continues.
I am really confused as to how this might happen & how to turn it around. We dont use any dodgy SEO tricks either.
-
So, first off, let me say that this isn't always a bad thing. Less indexed content, if much of your content is duplicated (or nearly duplicated) could actually improve the ranking of the rest of your content. More pages isn't better.
On the other hand, it's one thing when you proactively remove content from the index - it's another when Google does it for you. Are you seeing any patterns? As Chris said, it could be that your internal linking changed, or it could be that Google sees these pages as duplicate or low-quality and has removed them or implicitly canonicalized them (we're seeing more of that - it's like you have a rel=canonical on the page, but you don't). The other issue could be if there are duplicates on other site across the web, causing your copy to be filtered out.
Either way, you have to find out which pages are impacted and figure out the pattern. Do you have XML sitemaps? A well structured set of sitemaps can help you get a better sense of which pages are being indexed.
-
Also would you say it was a good or bad idea to stop tags and archives from being logged on the sitemap in wordpress SEO plug in? This may be an effecting issue?
-
Thanks for your response Chris.
I changed the theme of my site though I did a google search on it and it returned no problems? I have had no messages on my Webmaster tools. I have done a scan with the Screaming Frog (thank you for the suggestions) and a lot of other stuff comes up but not so many of my posts and I have thousands. I am guessing this might be something to do with it - a question - is google unable to access what's in a drop down menu? This might be a problem.
-
There was a rolling update on Google that started in May around the 22nd. You may have been affected. Check your GA to see if any notable activity or decrease happened on that date.
-
Lowhosjack,
If you've dropped from over 20K pages index to 133 without a drop in search traffic it would indicate a few things to me:
1. All of your search traffic is landing on those 133 pages -- Have you looked at your stats history to see that you haven't been receiving traffic from other sources to your site other than to those pages?
2. You changed your architecture or your internal linkingprevious to your drop in indexation.--Other than deleting the duplicate content, did you make any other changes to your site? You can crawl your site to verify Google can reach all of your pages with a tool like screamingfrog or xenu.
3. The content on those pages is low quality--Are you making sure that the content that you create is really worthwhile to your target audience?
If this was penalty related, I would think that the pages bringing in your traffic would be the ones hardest hit, so at this point, it doesn't look like a penalty but you really do need to get in to your stats and take a close look at what's been happening with the stats on those pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Domain Authority Keeps Dropping & FRED
Hi Moz! I've seen a big drop in Domain Authority 31 > 22 recently. I need a plan of what to sort out first, here are the points I know we need to improve: Page Speed Quality content - guides, blogs, videos Better UX experience to improve page engagement Backlinks - quality earned links & improvement of presence on social media This is our site http://www.key.co.uk/en/key/ I am the only SEO, with a small content team - who only really work on adding new products to the site. Our dev team are in France and we can be restricted by them. But I'm worried & I need a plan of what to tackle first to help improve this. We also saw keywords drop out in March - I'm assuming after Fred, some keywords aren't ones I would worry about, but then some are - for example - http://www.key.co.uk/en/key/dollies-load-movers-door-skates this page ranked at position 6 for Dollies - now dropped out altogether. Any ideas are welcome - help 🙂
Algorithm Updates | | BeckyKey2 -
Latest Best Practices for Single Page Applications
What are the latest best practices for SPA (single page application) experiences? Google is obviously crawling Javascript now, but is there any data to support that they crawl it as effectively as they do static content? Considering Bing (and Yahoo) as well as social (FB, Pinterest, etc) - what is the best practice that will cater to the lowest-common denominator bots and work across the board? Is a prerender solution still the advised route? Escaped fragments with snapshots at the expanded URLs, with SEO-friendly URL rewrites?
Algorithm Updates | | edmundsseo2 -
Dealing with Omitted Page
For my most competitive term, the wrong page ranks (and not well either). The landing page I built for it has never shown up for that term except after I include the omitted results. The page that does rank is category page page above it. All that's fine, because neither page was all that great...BUT, I have completely re-written the content for the landing page, got local area pictures, local testimonials and a video. So here's my question: Should I put all that content on the landing page that's been omitted or tweak the page that ranks and put it there? To me it makes the most sense to put the content on the page that has been omitted, but I don't know how google treats pages that have been omitted in the past. Is it going to have some sort of bias against the page, because it was omitted so many times earlier for that keyword? Or, will it be treated just like any other page, and if the content is good enough, then it will rank just fine. If anyone's dealt with this, then I'd love to hear all about it! Thanks, Ruben
Algorithm Updates | | KempRugeLawGroup0 -
Significant drop in traffic
Hi there, We run 3 websites in a similar niche (bins) but tend to have a different area of focus on each site, wheelie, recycling and general litter. They all have unique descriptions, images etc (as much as possible) One of our sites has been a long standing penalty sufferer and we still dont want to give up on it. They are all located on unique IP's but on the same server with the same owner in whois. My question is could our site that has struggled with a penalty in the past be effecting our other sites which havent had problems? I know google likes to see brands and we do regular content, social media etc on all the sites, The drop came today and appears across all our sites. The main site that had the penalty usually gets around 50 visits a day from search, so far today it has had 10 and that is most of the working day now gone. I hope someone can shed a little light on the issues we are facing Thank you Jon
Algorithm Updates | | imrubbish0 -
Search history Effects on SERPS
With search engines using adaptive search in their algo, what's the best way to reset? Currently I go to my browser which primarily is Safari second Firefox third Chrome, I empty the cache, clear history and remove all cookies and data. I also disable customerzation based on search history. Is this the best way of starting from scratch so my search results won't incorporate adaptive search tech? I also make sure I'm not signed into my gmail account since that can impact SERPS as well. What else should I be doing to make sure my search is not customized?
Algorithm Updates | | bronxpad1 -
Too Many On-Page Links
After running a site analysis on here it has come up and said that I have a lot o pages with too many on page links and that this might be why the site is being penalized. Thing is I am not sure how to remedy this as one page that says it has 116 links is this one : http://www.whosjack.org/10-films-with-some-crazy-bitches/ Although there is only one link in the body Then again our home page has 165 http://www.whosjack.org which again it says is too many. The thing is is that surely it doesn't count on links all over the page as other wise every news homepage would be penalised? For example what would happen here on this home page? : http://www.dazeddigital.com/ Can anyone help me see what I am missing? Are there possible hidden links anywhere I should be looking for etc? Thanks
Algorithm Updates | | luwhosjack0 -
Does google index non-public pages ie. members logged in page
hi, I was trying to locate resources on the topics regarding how much the google bot indexes in order to qualify a 'good' site on their engine. For example, our site has many pages that are associated with logged in users and not available to the public until they acquire a login username and password. Although those pages show up in google analytics, they should not be made public in the google index which is what happens. In light of Google trying to qualify a site according to how 'engaged' a user is on the site, I would feel that the activities on those member pages are very important. Can anyone offer suggestions on how Google treats those pages since we are planning to do further SEO optimization of those pages. Thanks
Algorithm Updates | | jumpdates0 -
Google and Content at Top of Page Change?
We always hear about how Google made this change or that change this month to their algorithm. Sometimes it's true and other times it's just a rumor. So this week I was speaking with someone in the SEO field who said that this week a change occurred at Google and is going to become more prevalent where content placed at the "top of the fold" on merchant sites with products are going to get better placement, rather than if you have your products at top with some content beneath them at the bottom of the page. Any comments on this?
Algorithm Updates | | applesofgold0