2 main factors here.
Time between getting out and wrapping yourself in a towel.
How much of your body is actually wetted.
The first means you have time to drop dry, before you grab your towel. It's only 10s or so, but you can shed a lot of water in that time.
The second matters, since you tend to keep your head out of the water in the pool, but soak it in the shower. Wet hair can hold a lot of water. Even if you don't dry your hair, the water will run down of the rest of you, as you dry yourself off.