Drop in Page Indexing, Small rise in Search Queries
-
Hello,
I have a news based website so i am creating multiple new posts daily. I changed a lot of the site and got rid of old potentially duplicate content back in feb and had a sharp drop in pages indexed. I know this was because I removed a lot of pages though. However I still have a good 20,000 + pages on my site and my indexing has dropped a further three times since then. From 9,000 to 2,000 a coupe of months ago and then slowly down since April to just 133.
It doesn't seem to have affected my search queries yet but surely will if it continues.
I am really confused as to how this might happen & how to turn it around. We dont use any dodgy SEO tricks either.
-
So, first off, let me say that this isn't always a bad thing. Less indexed content, if much of your content is duplicated (or nearly duplicated) could actually improve the ranking of the rest of your content. More pages isn't better.
On the other hand, it's one thing when you proactively remove content from the index - it's another when Google does it for you. Are you seeing any patterns? As Chris said, it could be that your internal linking changed, or it could be that Google sees these pages as duplicate or low-quality and has removed them or implicitly canonicalized them (we're seeing more of that - it's like you have a rel=canonical on the page, but you don't). The other issue could be if there are duplicates on other site across the web, causing your copy to be filtered out.
Either way, you have to find out which pages are impacted and figure out the pattern. Do you have XML sitemaps? A well structured set of sitemaps can help you get a better sense of which pages are being indexed.
-
Also would you say it was a good or bad idea to stop tags and archives from being logged on the sitemap in wordpress SEO plug in? This may be an effecting issue?
-
Thanks for your response Chris.
I changed the theme of my site though I did a google search on it and it returned no problems? I have had no messages on my Webmaster tools. I have done a scan with the Screaming Frog (thank you for the suggestions) and a lot of other stuff comes up but not so many of my posts and I have thousands. I am guessing this might be something to do with it - a question - is google unable to access what's in a drop down menu? This might be a problem.
-
There was a rolling update on Google that started in May around the 22nd. You may have been affected. Check your GA to see if any notable activity or decrease happened on that date.
-
Lowhosjack,
If you've dropped from over 20K pages index to 133 without a drop in search traffic it would indicate a few things to me:
1. All of your search traffic is landing on those 133 pages -- Have you looked at your stats history to see that you haven't been receiving traffic from other sources to your site other than to those pages?
2. You changed your architecture or your internal linkingprevious to your drop in indexation.--Other than deleting the duplicate content, did you make any other changes to your site? You can crawl your site to verify Google can reach all of your pages with a tool like screamingfrog or xenu.
3. The content on those pages is low quality--Are you making sure that the content that you create is really worthwhile to your target audience?
If this was penalty related, I would think that the pages bringing in your traffic would be the ones hardest hit, so at this point, it doesn't look like a penalty but you really do need to get in to your stats and take a close look at what's been happening with the stats on those pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Primary keyword in every page title of website
Hi all, We can see many website page titles are filled with "brand name & primary keyword" at suffix. Just wondering how much this gonna help. Or can we remove "primary keyword" from other non-relevant pages and limit the same to important pages to rank well? Thanks
Algorithm Updates | | vtmoz0 -
Ecommerce sites 30% drop in organic since the spring
I help manage SEO for a number of large retail websites and we've seen a significant drop in organic traffic (upwards of 30%) since around May 2015. It's likely we were hit my Google's Phantom Quality update, but I don't understand why it had such a big impact. Can anyone explain that Google update in more depth and advise on steps to take to recover from it? Thank you.
Algorithm Updates | | JimLynch0 -
Translate page?
Hi Guy's I have a question about Google asking me to translate the page when i search on brandname. It's in the Dutch Google and the searchquery is: "rotomshop" I can find why Google wants to translate the page because all our settings are Dutch. Does anyone have a suggestion? Thanks!
Algorithm Updates | | Happy-SEO1 -
Website Rankings Dropped April 12
A client website dropped drastically on April 12. Outside of some branded keywords, search results dropped off of the first page and are buried on page 3+ at best. Nothing has changed on the site, and there were no problems with the link profile. GWT has no manual actions. Kind of at a loss. Does anyone know if there was an algorithm update or anything external that may be causing some problems here? Site is www.averybiomedical.com if you want to take a look, but I'm just curious if there was anything I should be aware of. Thanks for the help!
Algorithm Updates | | AdamWormann0 -
Sudden drop after 301 redirection
Hi Experts We did a 301 redirect from an old site to a new site to get rid of any bad link juice. We recently found a big drop in rankings and traffic after google last indexed the new web pages. We did 301 using asp at page level coding. The website had 4000 approx. pages and we did 301 section by section. This is how we did as per one of the blog post in seomoz. Create a sitemap for your old domain. Create content (contact information, description of your company, indication of future plans) and something link worthy for the new domain. (You should start trying to build links early) Setup the new domain and make it live. Register and verify your old domain and new domain with Google Webmaster Tools. Create a custom 404 page for old domain which suggests visiting new domain. Old Domain error checking and fixing In a development environment, test the redirects from the old domain to the new domain. Ideally, this will be a 1:1 redirect. (www.example-old-site.com/category/sexy-mustaches.html to www.example-new-site.com/category/sexy-mustaches.html) 301 redirect your old domain to your new domain. Submit your old sitemap to Google and Bing. The submission pages are within Google Webmaster Tools and Bing Webmaster Center (This step will make the engines crawl your old URLs, see that they are 301 redirects and change their index accordingly.) Fill out the Change of Address form in Google Webmaster Tools. Create a new sitemap and submit it to the engines. (This will tell them about any new URLs that were not present on the old domain) Wait until Google Webmaster Tools updates and fix any errors it is indicated in the Diagnostics section. Monitor search engine results to make sure new domain is being properly indexed. We also did a press release with prweb to announce the new launch. We followed the steps recommended in one of the I am not sure what to do next. Can anyone suggest if its normal to see a drop and we should wait for some time or if we did something wrong? We are loosing business with every single day. Please help !
Algorithm Updates | | ITRIX0 -
Ranking drops over weekend
Hi all, Has anyone noticed any ranking changes over the weekend? I've noticed an almost uniform drop of a few positions across almost all of my chosen phrases. Nothing major has occurred on our site, no messages in webmaster tools. An analysis of our competitors positions (which we track the top 10) doesn't reveal any clues. Cheers Aran
Algorithm Updates | | Aran_Smithson1 -
Google Dropped 3,000+ Pages due to 301 Moved !! Freaking Out !!
We may be the only people stupid enough to accidentally prevent the google bot from indexing our site. In our htaccess file someone recently wrote the following statement RewriteEngine On
Algorithm Updates | | David_C
RewriteCond %{HTTP_HOST} ^mysite.com$ [NC]
RewriteRule ^(.*)$ http://www.mysite.com/$1 [L,R=301] Its almost funny because it was a rewrite that rewrites back to itself... We found in webmaster tools that the site was not able to be indexed by the google bot due to not detecting the robots.txt file. We didn't have one before as we didn't really have much that needed to be excluded. However we have added one now for kicks really. The robots.txt file though was never the problem with regard to the bot accessing the site. Rather it was the rewrite statement above that was blocking it. We tested the site not knowing what the deal was so we went under webmaster tools then health and then selected "Fetch as Google" to have the website. This was our way of manually requesting the site be re-indexed so we could see what was happening. After doing so we clicked on status and it provided the following: HTTP/1.1 301 Moved Permanently
Content-Length: 250
Content-Type: text/html
Location: http://www.mystie.com/
Server: Microsoft-IIS/7.5
MicrosoftOfficeWebServer: 5.0_Pub
MS-Author-Via: MS-FP/4.0
X-Powered-By: ASP.NET
Date: Wed, 22 Aug 2012 02:27:49 GMT
Connection: close <title>301 Moved Permanently</title> Moved Permanently The document has moved here. We changed the screwed up rewrite mistake in the htaccess file that found its way in there but now our issue is that all of our pages have been severely penalized with regard to where they are now ranking compared to just before the indecent. We are essentially freaking out because we don't know the real time consequences of this and if or how long it will take for the certain pages to regain their prior ranks. Typical pages when down anywhere between 9-40 positions on high volume search terms. So to say the least our company is already discussing the possibilities of fairly large layoffs based on what we anticipate with regard to the drop in traffic. This sucks because this is peoples lives but then again a business must make money and if you sell less you have to cut the overhead and the easiest one is payroll. I'm on a team with three other people that I work with to keep the SEO side up to snuff as much as we can and we sell high ticket items so the potential effects if Google doesn't restore matters could be significant. My question is what would you guys do? Is there any way we can contact Google about such a matter? If you can I've never seen such a thing. I'm sure the pages that are missing from the index now might make their way back in but what will there rank look like next time and with that type of rewrite has it permanently effected every page site wide, including those that are still in the index but severely effected by the index. Would love to see things bounce back quick but I don't know what to expect and neither do my counterparts. Thanks for any speculation, suggestions or insights of any kind!!!0 -
Troubleshooting Decline of Branded Keyword Searches
Hi, Over the past year, I have seen a huge change in the distribution of our organic keyword traffic. I'm trying to research why our branded keywords have gone down. Google analytics only shows me impressions for the past three months. Does anyone have ideas on how to explain this change in traffic? Please see the attached chart. Thanks! branded-v-nonbranded-organic-search.jpg
Algorithm Updates | | netdiva_amy0