Drop in Page Indexing, Small rise in Search Queries
-
Hello,
I have a news based website so i am creating multiple new posts daily. I changed a lot of the site and got rid of old potentially duplicate content back in feb and had a sharp drop in pages indexed. I know this was because I removed a lot of pages though. However I still have a good 20,000 + pages on my site and my indexing has dropped a further three times since then. From 9,000 to 2,000 a coupe of months ago and then slowly down since April to just 133.
It doesn't seem to have affected my search queries yet but surely will if it continues.
I am really confused as to how this might happen & how to turn it around. We dont use any dodgy SEO tricks either.
-
So, first off, let me say that this isn't always a bad thing. Less indexed content, if much of your content is duplicated (or nearly duplicated) could actually improve the ranking of the rest of your content. More pages isn't better.
On the other hand, it's one thing when you proactively remove content from the index - it's another when Google does it for you. Are you seeing any patterns? As Chris said, it could be that your internal linking changed, or it could be that Google sees these pages as duplicate or low-quality and has removed them or implicitly canonicalized them (we're seeing more of that - it's like you have a rel=canonical on the page, but you don't). The other issue could be if there are duplicates on other site across the web, causing your copy to be filtered out.
Either way, you have to find out which pages are impacted and figure out the pattern. Do you have XML sitemaps? A well structured set of sitemaps can help you get a better sense of which pages are being indexed.
-
Also would you say it was a good or bad idea to stop tags and archives from being logged on the sitemap in wordpress SEO plug in? This may be an effecting issue?
-
Thanks for your response Chris.
I changed the theme of my site though I did a google search on it and it returned no problems? I have had no messages on my Webmaster tools. I have done a scan with the Screaming Frog (thank you for the suggestions) and a lot of other stuff comes up but not so many of my posts and I have thousands. I am guessing this might be something to do with it - a question - is google unable to access what's in a drop down menu? This might be a problem.
-
There was a rolling update on Google that started in May around the 22nd. You may have been affected. Check your GA to see if any notable activity or decrease happened on that date.
-
Lowhosjack,
If you've dropped from over 20K pages index to 133 without a drop in search traffic it would indicate a few things to me:
1. All of your search traffic is landing on those 133 pages -- Have you looked at your stats history to see that you haven't been receiving traffic from other sources to your site other than to those pages?
2. You changed your architecture or your internal linkingprevious to your drop in indexation.--Other than deleting the duplicate content, did you make any other changes to your site? You can crawl your site to verify Google can reach all of your pages with a tool like screamingfrog or xenu.
3. The content on those pages is low quality--Are you making sure that the content that you create is really worthwhile to your target audience?
If this was penalty related, I would think that the pages bringing in your traffic would be the ones hardest hit, so at this point, it doesn't look like a penalty but you really do need to get in to your stats and take a close look at what's been happening with the stats on those pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Lost Wikipedia page and dropped heavily in rankings. How many of you aware of and experienced this?
Hi all, We lost of our Wikipedia page for 2nd time and we dropped in rankings 2nd time too. I got confused first time whether Wikipedia was the actual reason as we had couple of major changes in our website. But recently it's been clear that losing Wikipedia page is the culprit as we have no website changes around these days. How many of you aware of this and experienced this? Please share your views. Hope this info will help you. Thanks
Algorithm Updates | | vtmoz0 -
Ranking drop after image compression across website.
Hi all, Just checked my website in Google pagespeed insights and most of our website pages were required to reduce the images file size for better page loading. So I have compressed the images using https://compressor.io/ and https://tinypng.com/ and replaced the images. Then surprisingly ranking dropped even score improved for all pages with image optimisation. What would be the reason? Thanks
Algorithm Updates | | vtmoz0 -
Duplicate website got indexed: Caused rank drop?
Hi all, We have replica of our website with exact pages and content. That website got indexed by mistake and allowed for bots for more than 10 days. Our ranking dropped now and we moved from 2nd page to 5th page. But previously we had this happened and didn't hurt much. We got punished now? Thanks
Algorithm Updates | | vtmoz0 -
Absolutely gigantic drop in Ranking overnight
The site in question has been operating for around 3 months and for the first two months was nowhere to be seen in google results (literally page 10, 11 etc for all but branding searches). Then through a lot of hard work and the help of MozPro I managed to build it to a respectable 6th-10th place for the main keyphrases. Overnight on Wednesday we suddenly dropped half a dozen places or so and were rooted firmly mid table page 2 for both these phrases. Last night however we suddenly dropped from 14th to the very last result on page 10! for the biggest keyphrase where it has slowly dropped through the day to currently be sitting in 8th on page 11. Nothing is showing in Dashboard, theres no reason that I know of to be penalised, however even if we were penalised then surely that would be the site as a whole and not just 1 keyphrase? The weird thing is, when you look at the 1st 2 pages of the search a number of items have changed, a competitor which closed down is suddenly sitting mid table while other newcomers that were doing well have dropped, some of the older faces have gone up suddenly. If I didnt know better I would say that google has suffered a timewarp and is now serving results from a month ago for this keyphrase. Ive now noticed that the MozCast is reporting very stormy weather last night, surely however this couldnt be down to a change in Algorithm etc, not to produce such a massive drop for a site that has followed the rules (I refuse to link with a site that even remotely could be thought of as spam). Someone please tell me that google has been glitching and all will be well when I wake in the morning? Peter
Algorithm Updates | | Pwhitfield0 -
Ecommerce SEO: Is it bad to link to product/category pages directly from content pages?
Hi ! In Moz' Whiteboard friday video Headline Writing and Title Tag SEO in a Clickbait World, Rand is talking about (among other things) best practices related to linking between search, clickbait and conversion pages. For a client of ours, a cosmetics and make-up retailer, we are planning to build content pages around related keywords, for example video, pictures and text about make-up and fashion in order to best target and capture search traffic related to make-up that is prevalent earlier in the costumer journey. Among other things, we plan to use these content pages to link directly to some of the products. For example a content piece about how to achieve full lashes will to link to particular mascaras and/or the mascara category) Things is, in the Whiteboard video Rand Says:
Algorithm Updates | | Inevo
_"..So your click-bait piece, a lot of times with click-bait pieces they're going to perform worse if you go over and try and link directly to your conversion page, because it looks like you're trying to sell people something. That's not what plays on Facebook, on Twitter, on social media in general. What plays is, "Hey, this is just entertainment, and I can just visit this piece and it's fun and funny and interesting." _ Does this mean linking directly to products pages (or category pages) from content pages is bad? Will Google think that, since we are also trying to sell something with the same piece of content, we do not deserve to rank that well on the content, and won't be considered that relevant for a search query where people are looking for make-up tips and make-up guides? Also.. is there any difference between linking from content to categories vs. products? ..I mean, a category page is not a conversion page the same way a products page is. Looking forward to your answers 🙂0 -
Google Dropped 3,000+ Pages due to 301 Moved !! Freaking Out !!
We may be the only people stupid enough to accidentally prevent the google bot from indexing our site. In our htaccess file someone recently wrote the following statement RewriteEngine On
Algorithm Updates | | David_C
RewriteCond %{HTTP_HOST} ^mysite.com$ [NC]
RewriteRule ^(.*)$ http://www.mysite.com/$1 [L,R=301] Its almost funny because it was a rewrite that rewrites back to itself... We found in webmaster tools that the site was not able to be indexed by the google bot due to not detecting the robots.txt file. We didn't have one before as we didn't really have much that needed to be excluded. However we have added one now for kicks really. The robots.txt file though was never the problem with regard to the bot accessing the site. Rather it was the rewrite statement above that was blocking it. We tested the site not knowing what the deal was so we went under webmaster tools then health and then selected "Fetch as Google" to have the website. This was our way of manually requesting the site be re-indexed so we could see what was happening. After doing so we clicked on status and it provided the following: HTTP/1.1 301 Moved Permanently
Content-Length: 250
Content-Type: text/html
Location: http://www.mystie.com/
Server: Microsoft-IIS/7.5
MicrosoftOfficeWebServer: 5.0_Pub
MS-Author-Via: MS-FP/4.0
X-Powered-By: ASP.NET
Date: Wed, 22 Aug 2012 02:27:49 GMT
Connection: close <title>301 Moved Permanently</title> Moved Permanently The document has moved here. We changed the screwed up rewrite mistake in the htaccess file that found its way in there but now our issue is that all of our pages have been severely penalized with regard to where they are now ranking compared to just before the indecent. We are essentially freaking out because we don't know the real time consequences of this and if or how long it will take for the certain pages to regain their prior ranks. Typical pages when down anywhere between 9-40 positions on high volume search terms. So to say the least our company is already discussing the possibilities of fairly large layoffs based on what we anticipate with regard to the drop in traffic. This sucks because this is peoples lives but then again a business must make money and if you sell less you have to cut the overhead and the easiest one is payroll. I'm on a team with three other people that I work with to keep the SEO side up to snuff as much as we can and we sell high ticket items so the potential effects if Google doesn't restore matters could be significant. My question is what would you guys do? Is there any way we can contact Google about such a matter? If you can I've never seen such a thing. I'm sure the pages that are missing from the index now might make their way back in but what will there rank look like next time and with that type of rewrite has it permanently effected every page site wide, including those that are still in the index but severely effected by the index. Would love to see things bounce back quick but I don't know what to expect and neither do my counterparts. Thanks for any speculation, suggestions or insights of any kind!!!0 -
Bing Traffic drop
Anyone notice a drop in Bing traffic on January 26th? Slashed by 50% and holding for the past three weeks. 100% white hat site
Algorithm Updates | | loopyal0 -
What determines rankings in a site: search?
When I perform a "site:" search on my domains (without specifying a keyword) the top ranked results seem to be a mixture of sensible top-level index pages plus some very random articles. Is there any significance to what Google ranks highly in a site: search? There is some really unrepresentative content returned on page 1, including articles that get virtually no traffic. Is this seriously what Google considers our best or most typical content?
Algorithm Updates | | Dennis-529610