Male Fashion Advice

I'm starting to get more into high-rise pants due to their fit and comfort, but the biggest issue is that the pockets are at the waist (as they should be, I suppose)

It makes putting in my phone or wallet feel odd, as they are sitting at the side of my lower torso

Is that just something to deal with when wearing these pants?