I don't think any of us start out with enough patience! It's hard on the first batch (or 5th) to give it the time it really needs. I'm still in a rush to "do something" whenever I've got something going. It's taking a LOT of self control to just let stuff sit and age. Waiting does not come naturally to me.
I have come to accept the sediment in my earlier bottles. They have all been for home use anyways. Hopefully some of my later batches will be good enough to give away. Otherwise I've got to drink it all myself, and I don't think the wife would like that ::