IF you've never made wine before those off- smells and tastes may, as suggested go away or diminish to a point where you don't notice it. My first batches were a little scary and one or two did develop some 'interesting' flavors and smells. Only one batch seriously failed and that was interesting because it was one of 3 gallons of strawberry done exactly the same ( At least I thought they were) So out of 6 or 7 gallons one failure is acceptable to me just starting out. Not great, but not a failure.
I agree - see them through to the end - age them for at least 6 months and see how they change. Unless they develop seriously sulfuric or vinegar smells like the man at the roulette wheel - "Let it ride."