Everytime I have to lift something heavy I get the opposite of this. Like some six five guys will say it's super heavy meanwhile I am five five and just threw a fucking 75 lbs piece of furniture over my shoulder like it was a particularly large cat. I don't know if it's my height, muscle density, or just the autism but it's rather amusing watching folks universally balk at the situation.
It's partially your height. Naturally lower center of gravity means naturally better stability, plus the less you have to lower yourself to get a lifting grip on something the less effort int takes to get the thing and yourself back up.