Jim, this just goes to show that there's no sense in freaking out over a change in rankings based on 3 days' time. I can't even count the number of times I've seen a site drop after link building - only to come back to the same place or a higher placement a week later. This is typical and almost expected when I'm doing SEO. As long as you're not doing anything blackhat your site will be just fine. There's no way Google is going to single your tiny site out among billions of others.
In the future, give your site a minimum of 2 weeks. I think of it like this:
I do solid SEO. No blackhat. No crap. Because I do solid work I should be rewarded by Google and never penalized. With that in mind, if my site starts moving around in Google I know its a GOOD thing because it means Google is reevaluating my site. I also know that because I only do good work a reevaluation by Google is always going to show me in a favorable light. I want to see fluctuations in my rankings. It can only mean good things for me.