I don't think sitewide links are a good idea any more. Im sure they have been legitimately placed but in the eyes of a computer could look like paid links which as we all know is a bad thing.
My advice would be contact each website in turn and ask for an editorial link rather than a sidebar/sitewide link. This way you keep a genuine link.
If they refuse then I would ask for it to be removed as in my opinion these links are more than likely the cause of your penalty despite them being relevant as if they link to your fan site they are probably linking to lots of fan sites so could also look like a link ring of some sort.