You are correct. RO will remove a lot.
The rule of thumb is: If you like drinking your tap water, then use it for making wine.
RO units are NOT whole house filters. Whole house filters remove larger particles, and leave in all the other stuff you mentioned. You can also get them with carbon filters that will take out chlorine and organics (a little more polishing). In either case, the minerals stay in.
So, if you get a whole house filter, the water is fine for making wine. If you get an RO unit, then you might want to use tap water, not water from the RO spigot.
However, if your water has nasty minerals (like arsenic) then you will want to drink the RO water, and use bottled spring water to make wine.