Hey Karl,
I think Keri pretty much summed it up. You can edit the source in WordPress. On your WordPress dashboard home page, navigate to Appearance --> Editor. On the right sidebar of that page you should see a list of different links that navigate to different areas of your theme editor. Navigate to Header. This should be where the changes need to be made, but you can check all the pages for your theme if you are concerned. What pages are there will be a bit different for everyone depending on the theme. I'd always recommend saving a backup of your original theme before making changes though!
But I think taking Keri's advice and adding more quality content and getting rid of any suspect outbound links should help a lot.