He's smart, and also a monumental dickwad. I'd expect people that dislike him to do so for the latter, not the former. (i'm on that boat too)
I admit that I've never scrutinized his actions very closely, but I've never gotten that impression. Would you be willing to elaborate on why you feel that way?
From what I've seen/read of him as a person, he sounds like someone i would actively avoid in a social setting.