You are right, but you're missing the flipside of this: they also drive mental illness. Adaptations like these can be constructive or destructive to a person and society, and it's current consensus (which may be wrong), that it's better to have less of an ego in average case.