It's not necessarily an SEO problem (as long as you don't redirect all 404s to your homepage at least. I've seen that be an issue in the past.)
However, use it as an opportunity. Make the 404 a sales page if you have that many. It's a lander now for "the product you were searching for is out of stock - here are the search results on our site for similar products" etc. You can turn it into something productive to have that many 404s.
From WMT, mark them as fixed and then anytime one pops up, find out what is linking to the product and try to remove that link. You don't want to be linking to 404s internally if you can help it (bad user experience = Google's nightmare) so having 1000s of 404s isn't bad but try to break any internal links to them. (Xenu can help as well if you don't feel like waiting for WMT.)