Google: site gone from SERPs, back in 1 day, then gone again?
-
Last December we fumbled our 404 error page with a misconfigured server and broken links on the page.
Needless to say, our site dropped into an abyss - for 4 months. Yesterday we appeared again in our regular placement (actually stronger placement). Our site has been around since 09-Jan-1999 and has been a highly regarded site with good link structure and solid content for engineers.
Then today we're gone again. Yesterday morning we had 125,000 pages indexed with Google which grew to 187,000 by late afternoon. Then this morning we're nowhere to be found and only 21,800 pages are now indexed.
We've been working with Bruce Clay Inc through an SEO site audit doing several updates to improve through good seo practices. We haven't made any changes to the site since last Friday, April 13th (maybe the unlucky number has something to do with it....)
Any ideas, insight, suggestions???? Thanks!
-
Nathan please see my response to this question in the Private Q&A section. In short, I don't think this has to do with Google's goof-up a couple weeks ago, or with some of the other shifts, but I do think you are in violation of some of their guidelines on a pretty massive scale, although unintentionally and with good reason. I'll go ahead and paste my answer below, but the Private version includes links and other information that could identify the site.
Hello Nathan,
There were some pretty major shifts on the 16th, 19th and 24th-26th so the time-frame raises a red flag. However, with the little information I have (basically your indexation count) I think you may have a problem that isn't related to any of the recent algorithm shifts.
Assuming you are talking about ####.com, I show 462,000 indexed URLs from that domain. Nearly half a million URLs is quite a bit to index and you can imagine that Google might want to thin that out a bit and focus only on the ones that are important and original.
If you have 460k + pages, but most of them are duplicate content or significantly duplicate content, and most of them have no external links, this would put you in danger of being affected by several different algorithms/filters/penalties put in place by Google to keep such pages from bloating their index and outranking what they think to be "better" content.
That can be a hard pill to swallow because you know your content is good and people like what they find there. But let's look at this from the perspective of an impartial machine...
The following EXACT phrase appears, word-for-word, on about 22,800 different pages, most of them from within your site: "PHRASED REMOVED FOR PUBLIC VIEWING"
The following is typical of the "Related Terminology" section of your pages, which could be interpreted by Google as being keyword spam: "You may have searched any one of these terms to find this product: Keyword1, keyword2, keyword3, keyword4, keyword5, keyword6, keyword7, keyword8, so forth and so-on for a few dozen keywords".
A lot of these pages, possibly most of them, have very little unique/exclusive content. Instead, they list out features and uses from a database. Because of this you have many thousands of pages all with the same potential pool of words, each choosing to show more or less the same words in various orders and combinations. Furthermore, it is obvious that the pages are generated by a machine. Looking at this example, a "better" page would be one that has an introduction telling the visitor what "Polybenzimidazole (PBI) is and what it's used for in paragraph form, in addition to the list of features and uses: http://www.###.com/###/ . I'm sure most of your users will know what PBI is for if they search the site for it, but remember we're dealing with machine algorithms designed to detect spamming attempts, such as article spinning, which uses pretty much the same technique of switching around the order of words to generate hundreds or thousands of "articles" from a single original.
I wouldn't venture to provide specific advice on how to fix these issues without knowing more about your business. My suggestion is to look for a reputable outside SEO agency who can help you overcome these issues, which may involve removing a lot of pages from the index, allowing more content to be seen on each datasheet, or some other measures.
Good luck!
-
I hope they make the same mistake again - our website finally returned to normal positions in Google SERPs that we were at prior to our 404 error page mistake back in Dec. 2011.
Then yesterday, once again we've gone missing and are baffled at why and what to do... We did notice our site:www.ides.com raised from 21,800 pages yesterday to 124,000 today.
-
No, it's Google has work to do, they admitted it was their fault and something went wrong in their classifier.
-
If my site was mistaken for a parked domain.....then I have a lot of work to do. lol
-
It might actually have been Google's fault this time. They misclassified some sites as parked domains and they dropped out of the index. See the Search Engine Land post at http://searchengineland.com/dropped-in-rankings-google-mistake-over-parked-domains-118979.
-
Our representative at Bruce Clay Inc just replied with the following info, so something's up...
"We’re pretty clueless too. The whole Internet went a little crazy yesterday because of a big shakeup in Google’s results, and there are a few theories as to what exactly happened. From the forums it looked like a lot of sites lost all their rankings."
They are looking into our Google Webmaster Tools and Analytics accounts to see if they can pick up any clues.
-
We disappeared for about 16 hours yesterday completely from the SERPS then last night it popped back up and we were ranked higher for all our keywords. I deleted one duplicate page on a directory but I am not sure what transpired to cause the events. Hopefully someone else will have some input and let me know if this is a common occurrence.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can't get Google to index our site although all seems very good
Hi there, I am having issues getting our new site, https://vintners.co indexed by Google although it seems all technical and content requirements are well in place for it. In the past, I had way poorer websites running with very bad setups and performance indexed faster. What's concerning me, among others, is that the crawler of Google comes from time to time when looking on Google Search Console but does not seem to make progress or to even follow any link and the evolution does not seem to do what google says in GSC help. For instance, our sitemap.xml was submitted, for a few days, it seemed like it had an impact as many pages were then visible in the coverage report, showing them as "detected but not yet indexed" and now, they disappeared from the coverage report, it's like if it was not detected any more. Anybody has any advice to speed up or accelerate the indexing of a new website like ours? It's been launched since now almost two months and I was expected, at least on some core keywords, to quickly get indexed.
Technical SEO | | rolandvintners1 -
My Website's Home Page is Missing on Google SERP
Hi All, I have a WordPress website which has about 10-12 pages in total. When I search for the brand name on Google Search, the home page URL isn't appearing on the result pages while the rest of the pages are appearing. There're no issues with the canonicalization or meta titles/descriptions as such. What could possibly the reason behind this aberration? Looking forward to your advice! Cheers
Technical SEO | | ugorayan0 -
Migrated site back in April and rankings have not returned.
I sure hope someone can help me with this. Back in April I migrated my site and did a website redesign. We implemented all the 301 redirect page for page. I lost about 40% of traffic. My main key word is baby headbands that goes to our home page. www.princessbowtique.com We were ranking at number two and have fallen down to number 9 and 10 and have recently come back up to number 8. My question is and I am wondering if there is something wrong with my HTML Code, or something else. All other pages stay lost some rankings but not as much a my home page. This home page is what gets most of my traffic and we are really hurting. I've had to let go of my employees and it's looking really bad for our business. Anyhow I'm trying to figure out what I can do it improve. I migrated to Big Commerce and they did all the 301 redirects. All catagories stayed the same url but the product pages did have 301 redirects.
Technical SEO | | PB20070 -
Anything new if determining how many of a sites pages are in Google's supplemental index vs the main index?
Since site:mysite.com *** -sljktf stopped working to find pages in the supplemental index several years ago has anyone found another way to identify content that has been regulated to the supplemental index?
Technical SEO | | SEMPassion0 -
Redirecting HTTP to HTTPS - How long does it take Google to re-index the site?
hello Moz We know that this year, Moz changed its domain to moz.com from www.seomoz.org
Technical SEO | | joony
however, when you type "site:seomoz.org" you still can find old urls indexed on Google (on page 7 and above) We also changed our site from http://www.example.com to https://www.example.com
And Google is indexing both sites even though we did proper 301 redirection via htaccess. How long would it take Google to refresh the index? We just don't worry about it? Say we redirected our entire site. What is going to happen to those websites that copied and pasted our content? We have already DMCAed their webpages, but making our site https would mean that their website is now more original than our site? Thus, Google assumes that we have copied their site? (Google is very slow on responding to our DMCA complaint) Thank you in advance for your reply.0 -
Staging site and "live" site have both been indexed by Google
While creating a site we forgot to password protect the staging site while it was being built. Now that the site has been moved to the new domain, it has come to my attention that both the staging site (site.staging.com) and the "live" site (site.com) are both being indexed. What is the best way to solve this problem? I was thinking about adding a 301 redirect from the staging site to the live site via HTACCESS. Any recommendations?
Technical SEO | | melen0 -
Google Has Indexed Most of My Site, why won't Bing?
We've got 600K+ pages indexed by Google and have submitted our same sitemap.xml's to Bing, but have only seen 100-200 pages get indexed by Bing. Is this fairly typical? Is there anything further we can do to increase indexation on Bing?
Technical SEO | | jamesti0 -
Are lots of links from an external site to non-existant pages on my site harmful?
Google Webmaster Tools is reporting a heck of a lot of 404s which are due to an external site linking incorrectly to my site. The site itself has scraped content from elsewhere and has created 100's of malformed URLs. Since it unlikely I will have any joy having these linked removed by the creator of the site, I'd like to know how much damage this could be doing, and if so, is there is anything I can do to minimise the impact? Thanks!
Technical SEO | | Nobody15569050351140