There is a difference between benefiting materially or politically from how society is structured and social respect. There is a difference between paying someone more or less for doing a job and how you treat someone when you interact to them.
Let me put it a different way... why should you respect raw intelligence over a person's height? After all, both simply an accident of birth (genetics and early nutrition). Neither are something one achieves.
I do not respect raw intelligence. I respect personality traits such as hard work, honesty, reliability, affability and bravery. I respect achievement, not potential. To tie someone's worth to inherent traits such as intelligence is, to me, somewhat shallow.