Half of any population is below average on any (and every!) metric. That's why they call it an average. Right?
The problem instead is that our "rights" are treated as privileges that can be revoked when the powers that be deem it convenient. Our rights should be rights regardless of our intelligence. Though perhaps the responsibility for securing those rights falls most heavily upon the cleverest among us..in which case the problem isn't that there are folks of below average intelligence, it's that those particularly blessed with keen minds aren't doing enough to defend the rights of us all.
Imagine an "education" scale of 1-20.
If you have 3 persons with 12 and one with 20, then the average is 14 -- and you have MORE than half of the people below average.