While I'm certainly not engaged in any form of blackhat techniques, we were severely affected by Penguin. Needless to say, we suffered a 50% drop on April 24 and have not risen back since. For that reason, yes, I do have link paranoia - good term
I'm thinking of making another post on the subject (YouMoz) because I've finally figured out what happened. I'm hoping this next update will catch my fix.
For the record, they are not spammy but rather topical sites and directories related to Ghosts or New Age stuff. Again, we have nothing to do with these topics.
Seems like the consensus is just leave them. There are about two dozen out of 2000 links I manually reviewed in a spreadsheet.