Those seem to be a light aluminum on many bottles. I have modified a 3" putty knife into a concave shape and sharpened it - works on the stubborn labels and the top sleeves. Watch your fingers, tho.
I had a nice old carpet cutting knife with a curved blade. Worked really well on bottle labels. The knife disappeared from my house...it’s not the only thing getting old I’m afraid.