I am not too sure about it. I've seen one project in the past where a site most likely was penalized after the same kind of scenario and it was much less pages that were indexed. The site didn't rank for over a year for it's own domain name.
Also I am not sure about the thousands of indexed pages, if I can just let them become 404 errors or if I should do some redirect. Or perhaps should I remove the pages from the index via WMT?