No. Anyone can build links to any site.
You can always ask webmasters to remove links, but they are much easier to build than have them removed. If the site is stating false negative information about your site, it might be considered libel and you could try to threaten legal action.