What barnacled is saying is absolutely true, and unless you've spent time as a single man of below average height, you really just won't understand.
The difference in attention and respect that a few inches make is pretty astounding. I'd imagine it's pretty similar to the stories I hear of people shedding hundreds of pounds and being treated as a completely different person. Once again, unless you've been on both sides of the equation, it's unlikely you'll be able to grasp how much physical traits like height and weight affect how people treat you.