Mint and Lime sounds like a good combe. But yes, the pith could be bad. I tried a fresh orange wine. I peeled and discarded the peels but left the whithe pith on the "meat" before I pureed them in the cuisinart. What a disaster, the only wine I ever dumped.
The white pith is not good. You may notice that most citrus wines that call for peel, only mention zest, no pith involved.
Sounds good though keep us posted.