I can only talk for my experience - I’m 5’8” and over 40, and I don’t think height has ever made much of a difference in my relationships (or rather lack thereof), whereas my general appearance and dullness definitely did at various points. I still reckon that if I were ripped and/or better looking and/or rich and/or wittier, it would make a world of difference, whereas an extra few inches alone would not. I know taller guys with much less “pull” than me, and shorter ones who kill it year after year. But I guess I don’t know anyone smaller than 5’6”.
On the mocking, I agree but hopefully that’s slowly going away. It’s one of those things, like casual racism and casual sexism, that will take a while to fully disappear from everyday conversations. Some animal instincts are just what they are.