Google: site gone from SERPs, back in 1 day, then gone again?
-
Last December we fumbled our 404 error page with a misconfigured server and broken links on the page.
Needless to say, our site dropped into an abyss - for 4 months. Yesterday we appeared again in our regular placement (actually stronger placement). Our site has been around since 09-Jan-1999 and has been a highly regarded site with good link structure and solid content for engineers.
Then today we're gone again. Yesterday morning we had 125,000 pages indexed with Google which grew to 187,000 by late afternoon. Then this morning we're nowhere to be found and only 21,800 pages are now indexed.
We've been working with Bruce Clay Inc through an SEO site audit doing several updates to improve through good seo practices. We haven't made any changes to the site since last Friday, April 13th (maybe the unlucky number has something to do with it....)
Any ideas, insight, suggestions???? Thanks!
-
Nathan please see my response to this question in the Private Q&A section. In short, I don't think this has to do with Google's goof-up a couple weeks ago, or with some of the other shifts, but I do think you are in violation of some of their guidelines on a pretty massive scale, although unintentionally and with good reason. I'll go ahead and paste my answer below, but the Private version includes links and other information that could identify the site.
Hello Nathan,
There were some pretty major shifts on the 16th, 19th and 24th-26th so the time-frame raises a red flag. However, with the little information I have (basically your indexation count) I think you may have a problem that isn't related to any of the recent algorithm shifts.
Assuming you are talking about ####.com, I show 462,000 indexed URLs from that domain. Nearly half a million URLs is quite a bit to index and you can imagine that Google might want to thin that out a bit and focus only on the ones that are important and original.
If you have 460k + pages, but most of them are duplicate content or significantly duplicate content, and most of them have no external links, this would put you in danger of being affected by several different algorithms/filters/penalties put in place by Google to keep such pages from bloating their index and outranking what they think to be "better" content.
That can be a hard pill to swallow because you know your content is good and people like what they find there. But let's look at this from the perspective of an impartial machine...
The following EXACT phrase appears, word-for-word, on about 22,800 different pages, most of them from within your site: "PHRASED REMOVED FOR PUBLIC VIEWING"
The following is typical of the "Related Terminology" section of your pages, which could be interpreted by Google as being keyword spam: "You may have searched any one of these terms to find this product: Keyword1, keyword2, keyword3, keyword4, keyword5, keyword6, keyword7, keyword8, so forth and so-on for a few dozen keywords".
A lot of these pages, possibly most of them, have very little unique/exclusive content. Instead, they list out features and uses from a database. Because of this you have many thousands of pages all with the same potential pool of words, each choosing to show more or less the same words in various orders and combinations. Furthermore, it is obvious that the pages are generated by a machine. Looking at this example, a "better" page would be one that has an introduction telling the visitor what "Polybenzimidazole (PBI) is and what it's used for in paragraph form, in addition to the list of features and uses: http://www.###.com/###/ . I'm sure most of your users will know what PBI is for if they search the site for it, but remember we're dealing with machine algorithms designed to detect spamming attempts, such as article spinning, which uses pretty much the same technique of switching around the order of words to generate hundreds or thousands of "articles" from a single original.
I wouldn't venture to provide specific advice on how to fix these issues without knowing more about your business. My suggestion is to look for a reputable outside SEO agency who can help you overcome these issues, which may involve removing a lot of pages from the index, allowing more content to be seen on each datasheet, or some other measures.
Good luck!
-
I hope they make the same mistake again - our website finally returned to normal positions in Google SERPs that we were at prior to our 404 error page mistake back in Dec. 2011.
Then yesterday, once again we've gone missing and are baffled at why and what to do... We did notice our site:www.ides.com raised from 21,800 pages yesterday to 124,000 today.
-
No, it's Google has work to do, they admitted it was their fault and something went wrong in their classifier.
-
If my site was mistaken for a parked domain.....then I have a lot of work to do. lol
-
It might actually have been Google's fault this time. They misclassified some sites as parked domains and they dropped out of the index. See the Search Engine Land post at http://searchengineland.com/dropped-in-rankings-google-mistake-over-parked-domains-118979.
-
Our representative at Bruce Clay Inc just replied with the following info, so something's up...
"We’re pretty clueless too. The whole Internet went a little crazy yesterday because of a big shakeup in Google’s results, and there are a few theories as to what exactly happened. From the forums it looked like a lot of sites lost all their rankings."
They are looking into our Google Webmaster Tools and Analytics accounts to see if they can pick up any clues.
-
We disappeared for about 16 hours yesterday completely from the SERPS then last night it popped back up and we were ranked higher for all our keywords. I deleted one duplicate page on a directory but I am not sure what transpired to cause the events. Hopefully someone else will have some input and let me know if this is a common occurrence.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Spam Score Of Site Increased from 1 to 31% overnight
Hello There,
Technical SEO | | rohit.c
Few days back, Spam Score of two of my sites drastically increased from 1% to 31% for one site and from 1% to 36% for another site overnight. Here are the two websites https://simpalm.com/ ducknowl.com Site background for 2-3 months ABC link exchange campaign was started for both the sites. Links where built on high quality sites with DA40 above and most of them are Saas sites No reciprocal link exchange was done Same new pages are created on the site for on page SEO Both the sites are hosted on GoDaddy Can someone please tell me what is the reason of this Sudden increase in spam score of both the sites and at same time?1 -
Recently re-built our site and changed domain. Now I want to go back to old domain - it it a bad idea?
About a year ago I rebuilt our website and changed our domain name. We rent villas in Tuscany, we used to be 'invitationtotuscany.com'. Then I started doing the same in Provence, and in the italian lakes, so i had further sites called invitationtoprovence.com and invitationtotheitalianlakes.com. But maintaining them was awkward and I wanted to have one site. So I put them all onto invitationto.com and did 301s from the old domains and sites. Now I'd dropped off organic search results and I've also realised that invitationto.com is far less clear as a business address. My inclination is to go back to invitationtotuscany.com - Tuscany is still 80% of our business and have the other areas in there too - optimised for SEO for Provence etc. I'm being told its a really bad idea to change domain, 301 the old one, and then revert to the original domain. But I'm suffering anyway, so I wonder if I sjhouldn't just bite the bullet. A lot of my old good backlinks still point to invitationtotuscany.com (BBC, Sunday Times, etc) and the DA is 33 against 22 on the new one.. All help gratefully received! : )
Technical SEO | | DanWrightson0 -
Can anyone tell me why some of the top referrers to my site are porn site?
We noticed today that 4 of the top referring sites are actually porn sites. Does anyone know what that is all about? Thanks!
Technical SEO | | thinkcreativegroup1 -
Could using our homepage Google +1's site wide harm our website?
Hello Moz! We currently have the number of Google +1's for our homepage displaying on all pages of our website. Could this be viewed as black hat/manipulative by Google, and result in harming our website? Thanks in advance!
Technical SEO | | TheDude0 -
Google having trouble accessing my site
Hi google is having problem accessing my site. each day it is bringing up access denied errors and when i have checked what this means i have the following Access denied errors In general, Google discovers content by following links from one page to another. To crawl a page, Googlebot must be able to access it. If you’re seeing unexpected Access Denied errors, it may be for the following reasons: Googlebot couldn’t access a URL on your site because your site requires users to log in to view all or some of your content. (Tip: You can get around this by removing this requirement for user-agent Googlebot.) Your robots.txt file is blocking Google from accessing your whole site or individual URLs or directories. Test that your robots.txt is working as expected. The Test robots.txt tool lets you see exactly how Googlebot will interpret the contents of your robots.txt file. The Google user-agent is Googlebot. (How to verify that a user-agent really is Googlebot.) The Fetch as Google tool helps you understand exactly how your site appears to Googlebot. This can be very useful when troubleshooting problems with your site's content or discoverability in search results. Your server requires users to authenticate using a proxy, or your hosting provider may be blocking Google from accessing your site. Now i have contacted my hosting company who said there is not a problem but said to read the following page http://www.tmdhosting.com/kb/technical-questions/other/robots-txt-file-to-improve-the-way-search-bots-crawl/ i have read it and as far as i can see i have my file set up right which is listed below. they said if i still have problems then i need to contact google. can anyone please give me advice on what to do. the errors are responce code 403 User-agent: *
Technical SEO | | ClaireH-184886
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/0 -
Small business sites banned by google. Please help.
Hi. My 2 sites http://www.painterdublin.com and http://www.tilers-dublin.com were banned by google update in November 2012. Both were ranking fairly well in search results: painterdublin generating cca 600/month and tilers-dublin cca 300/month organic traffic from google. After update it is about 70% less. Is there anyone willing to take a look at my pages and give me some advice about what to do to improve the situation? thank you very much
Technical SEO | | jarik0 -
Will Google index a site with white text? Will it give it bad ratings?
Will google not rank a site bc pretty much all the copy is white (and the background is all white)? Here's the site in question: https://www.dropbox.com/s/6w24f6h5p0zaxhg/Garrison_PLAY.vs2-static.pdf https://www.dropbox.com/sh/fwudppvwy2khpau/t43NozpG3E/Garrison_PLAY.vs3.jpg thanks--if you need me to clarify more let me know TM Humphries LocalSearched.com
Technical SEO | | CloudGuys0 -
What are the pros and cons of moving one site onto a subdomain of another site?
Two sites. One has weaker sales. What would the benefits and problems for SEO of moving the weak site from its own domain to a subdomain of the stronger site?
Technical SEO | | GriffinHansen0