The short answer is yes, but there are some caveats.
It depends on what you mean by the word "penalty". If you had a manual penalty (Google sent you a message through Google Webmaster Tools), then the best answer is usually to remove the offensive links, submit a reconsideration request, and replace those links with good ones. If, on the other hand, you had a drastic drop in rank due to an algorithm update, removing links will do nothing for you. Based on what you're saying (and correct me if I'm wrong), this sounds like what is happening with you.
In that scenario, the links that got you the ranking for "schrader valve" were most likely devalued and don't count against you. They're just not helping you anymore either. Your time would be best invested into earning stronger links.
Let me know if I misunderstood your question...