I see the value in charisma, but it seems uncontroversial to me that what most people consider "fair" is hiring people for their skill at a job, not their ability to make the interviewer like them.
Essentially, you need just enough charisma to avoid being steamrolled by others when you're right and they are not, while not having enough to steamroll them when it's the other way around.