I've never made this kind of wine, but in the book Home Winemaking by Terry Garey, as a note to her recipe for Orange Wine, she recommends using only 6 to 7 lime for Lime Wine, the zest from 2 or 3 of them, along with 2 lbs sugar, no added acid, 1 tsp yeast nutrient, 1/4 tsp tannin, and 1/2 tsp pectic enzyme. All the citrus recipes I've seen too all recommend avoiding getting any of the white pith into the mix. Not that I can speak from any experience, but thought I'd share what that book had.