Good Question Luis,
Suggested Process below:
- Get a list of all your backlinks
- Make a list of all the known bad neighborhoods. You might have to research SEO blogs for this info
- Compare that with your list of backlinks
- You can also manually check any site to see if it is indexed in Google or not to confirm it's negative impact.
Here is a link to a useful post to get you started