Google: site gone from SERPs, back in 1 day, then gone again?
-
Last December we fumbled our 404 error page with a misconfigured server and broken links on the page.
Needless to say, our site dropped into an abyss - for 4 months. Yesterday we appeared again in our regular placement (actually stronger placement). Our site has been around since 09-Jan-1999 and has been a highly regarded site with good link structure and solid content for engineers.
Then today we're gone again. Yesterday morning we had 125,000 pages indexed with Google which grew to 187,000 by late afternoon. Then this morning we're nowhere to be found and only 21,800 pages are now indexed.
We've been working with Bruce Clay Inc through an SEO site audit doing several updates to improve through good seo practices. We haven't made any changes to the site since last Friday, April 13th (maybe the unlucky number has something to do with it....)
Any ideas, insight, suggestions???? Thanks!
-
Nathan please see my response to this question in the Private Q&A section. In short, I don't think this has to do with Google's goof-up a couple weeks ago, or with some of the other shifts, but I do think you are in violation of some of their guidelines on a pretty massive scale, although unintentionally and with good reason. I'll go ahead and paste my answer below, but the Private version includes links and other information that could identify the site.
Hello Nathan,
There were some pretty major shifts on the 16th, 19th and 24th-26th so the time-frame raises a red flag. However, with the little information I have (basically your indexation count) I think you may have a problem that isn't related to any of the recent algorithm shifts.
Assuming you are talking about ####.com, I show 462,000 indexed URLs from that domain. Nearly half a million URLs is quite a bit to index and you can imagine that Google might want to thin that out a bit and focus only on the ones that are important and original.
If you have 460k + pages, but most of them are duplicate content or significantly duplicate content, and most of them have no external links, this would put you in danger of being affected by several different algorithms/filters/penalties put in place by Google to keep such pages from bloating their index and outranking what they think to be "better" content.
That can be a hard pill to swallow because you know your content is good and people like what they find there. But let's look at this from the perspective of an impartial machine...
The following EXACT phrase appears, word-for-word, on about 22,800 different pages, most of them from within your site: "PHRASED REMOVED FOR PUBLIC VIEWING"
The following is typical of the "Related Terminology" section of your pages, which could be interpreted by Google as being keyword spam: "You may have searched any one of these terms to find this product: Keyword1, keyword2, keyword3, keyword4, keyword5, keyword6, keyword7, keyword8, so forth and so-on for a few dozen keywords".
A lot of these pages, possibly most of them, have very little unique/exclusive content. Instead, they list out features and uses from a database. Because of this you have many thousands of pages all with the same potential pool of words, each choosing to show more or less the same words in various orders and combinations. Furthermore, it is obvious that the pages are generated by a machine. Looking at this example, a "better" page would be one that has an introduction telling the visitor what "Polybenzimidazole (PBI) is and what it's used for in paragraph form, in addition to the list of features and uses: http://www.###.com/###/ . I'm sure most of your users will know what PBI is for if they search the site for it, but remember we're dealing with machine algorithms designed to detect spamming attempts, such as article spinning, which uses pretty much the same technique of switching around the order of words to generate hundreds or thousands of "articles" from a single original.
I wouldn't venture to provide specific advice on how to fix these issues without knowing more about your business. My suggestion is to look for a reputable outside SEO agency who can help you overcome these issues, which may involve removing a lot of pages from the index, allowing more content to be seen on each datasheet, or some other measures.
Good luck!
-
I hope they make the same mistake again - our website finally returned to normal positions in Google SERPs that we were at prior to our 404 error page mistake back in Dec. 2011.
Then yesterday, once again we've gone missing and are baffled at why and what to do... We did notice our site:www.ides.com raised from 21,800 pages yesterday to 124,000 today.
-
No, it's Google has work to do, they admitted it was their fault and something went wrong in their classifier.
-
If my site was mistaken for a parked domain.....then I have a lot of work to do. lol
-
It might actually have been Google's fault this time. They misclassified some sites as parked domains and they dropped out of the index. See the Search Engine Land post at http://searchengineland.com/dropped-in-rankings-google-mistake-over-parked-domains-118979.
-
Our representative at Bruce Clay Inc just replied with the following info, so something's up...
"We’re pretty clueless too. The whole Internet went a little crazy yesterday because of a big shakeup in Google’s results, and there are a few theories as to what exactly happened. From the forums it looked like a lot of sites lost all their rankings."
They are looking into our Google Webmaster Tools and Analytics accounts to see if they can pick up any clues.
-
We disappeared for about 16 hours yesterday completely from the SERPS then last night it popped back up and we were ranked higher for all our keywords. I deleted one duplicate page on a directory but I am not sure what transpired to cause the events. Hopefully someone else will have some input and let me know if this is a common occurrence.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Removing site subdomains from Google search
Hi everyone, I hope you are having a good week? My website has several subdomains that I had shut down some time back and pages on these subdomains are still appearing in the Google search result pages. I want all the URLs from these subdomains to stop appearing in the Google search result pages and I was hoping to see if anyone can help me with this. The subdomains are no longer under my control as I don't have web hosting for these sites (so these subdomain sites just show a default hosting server page). Because of this, I cannot verify these in search console and submit a url/site removal request to Google. In total, there are about 70 pages from these subdomains showing up in Google at the moment and I'm concerned in case these pages have any negative impacts on my SEO. Thanks for taking the time to read my post.
Technical SEO | | QuantumWeb620 -
Google not indexing /showing my site in search results...
Hi there, I know there are answers all over the web to this type of question (and in Webmaster tools) however, I think I have a specific problem that I can't really find an answer to online. site is: www.lizlinkleter.com Firstly, the site has been live for over 2 weeks... I have done everything from adding analytics, to submitting a sitemap, to adding to webmaster tools, to fetching each individual page as googlebot and then submitting to index via webmaster tools. I've checked my robot files and code elsewhere on the site and the site is not blocking search engines (as far as I can see) There are no security issues in webmaster tools or MOZ. Google says it has indexed 31 pages in the 'Index Status' section, but on the site dashboard it says only 2 URLS are indexed. When I do a site:www.lizlinketer.com search the only results I get are pages that are excluded in the robots file: /xmlrpc.php & /admin-ajax.php. Now, here's where I think the issue stems from - I developed the site myself for my wife and I am new to doing this, so I developed it on the live URL (I now know this was silly) - I did block the content from search engines and have the site passworded, but I think Google must have crawled the site before I did this - the issue with this was that I had pulled in the Wordpress theme's dummy content to make the site easier to build - so lots of nasty dupe content. The site took me a couple of months to construct (working on it on and off) and I eventually pushed it live and submitted to Analytics and webmaster tools (obviously it was all original content at this stage)... But this is where I made another mistake - I submitted an old site map that had quite a few old dummy content URLs in there... I corrected this almost immediately, but it probably did not look good to Google... My guess is that Google is punishing me for having the dummy content on the site when it first went live - fair enough - I was stupid - but how can I get it to index the real site?! My question is, with no tech issues to clear up (I can't resubmit site through webmaster tools) how can I get Google to take notice of the site and have it show up in search results? Your help would be massively appreciated! Regards, Fraser
Technical SEO | | valdarama0 -
How to display the full structure of website on Google serps
I have been searching around but unable to gather information as to how we can control or list top pages of a website on Google's first page , i.e. if we type seomoz in google , we can see the main listing with 6 subdomain listings , which link to Blog , Seo tool , Beginner Seo guide , Learn Seo , Pricing & Plans and login My question is can we control these listings i.e. what to display and what not , and if yes how can we make this type of visibility on first page , by using html or xml sitemaps or theirs something mostly websites are missing. Cause this type of data is coming up for very less websites and mostly websites are with single urls. c43Ki.jpg
Technical SEO | | ngupta10 -
Site migration from Drupal to WordPress - Question about Drupal Back end
This is really a developer/Webmaster issue. The closest category available to select was "Technical SEO" - but technically, this isn't a question about SEO, per se. I am doing free SEO work for a local arts organization as my way of giving them a charitable contribution. Despite my advice to stay on Drupal and improve the site on its current platform, they want something easier to manage for volunteers. This is perfectly understandable, although not my recommendation. Of course, not knowing anything about SEO, their first impulse was to simply shut down the old site, cancel all of their old pages, point the domain to their new WordPress site and completely start over. Thank goodness I yelled "Halt!" before they went this far 🙂 They really have no idea what they are doing and I want to help guide them through this process in a way that preserves as much as possible their inbound links (they have tons of .edu and .gov links because they are a local community arts organization). Of course they don't understand how valuable these are, so I have a lot of educating to do. I am trying to get them a quote from a professional developer to help migrate from Drupal to WordPress. The only login information anyone has been able to send me is login to their FTP. No one seems to have a login for the Drupal CMS back end, and when I asked for it they looked like deer caught in headlights Can someone tell me, or even send me a screenshot of what the admin login page looks like for a Drupal site, so I can explain better to this client what I am looking for? I have no experience with Drupal, but surely, there is a backend where the site pages and content can be updated.? There must also be a database of customers/registrants, etc. not to mention a place where all the meta tags, etc can be entered and stored? Last but not least, if no one is able to find their site's Drupal login info, is there any way under the sun for me to retrieve it for them? I have a Developer in mind whose got loads of experience migrating from Drupal to WP, but he needs a .sql export file with the contents of the curent databse in order to give us a quote. Does anyone have any advice? (Other than "This should teach you not to offer your services up to charity!" LOL)
Technical SEO | | danatanseo0 -
I think google thinks i have two sites when i only have one
Hi, i am a bit puzzled, i have just used http://www.opensiteexplorer.org/anchors?site=in2town.co.uk to check my anchor text and forgot to put in the www. and the information came up totally different from when i put the www. in it shows a few links for the in2town.co.uk but then when i put in www.in2town.co.uk it gives me different information, is this a problem and if so how do i solve this | | | | | | | | |
Technical SEO | | ClaireH-184886
| | | | | | | | |0 -
Remove Site from Google
How can I get my website out of google? I want all pages completely gone. Thanks!
Technical SEO | | tylerfraser0 -
Google SERPs and NoIndex directives.
We have pages that have been added to robots.txt as url patterns in DisAllow. Also, we have the meta noindex tags on the pages themselves. But we are finding the pages in index. I don't think they are higher up in the rankings and they don't have any descriptions, any previews or any cached pages. Why does Google show these pages? Could it be due to internal or external linking?
Technical SEO | | gaganc0 -
Adding Google +1 To My Site
This may seem like a silly question, but I had my site designed by a third party and I don't know how to find this info. I want to add Google +1 button to my site. I've already added the script that makes it work in my , but don't know how to add the to the part of my site I'd like the icon to appear. If you take a look at my site, http://www.youdrivethesuccess.com/, you will see the twitter and facebook icons that follow you around the site in the top right of the page. I'd like to drop in the +1 right next to them, but I don't know how to get to it. How do I access this on the server? What section of my FTP do these lil icons live? A folder? Any direction is greatly appreciated...thanks.
Technical SEO | | brentmitchell0