Hmm. I've never cared about that. For whatever reason. I generally don't care what other people think - especially after I read Feynman's book of the same name decades ago.
Feynman certainly cared a great deal about what others thought of him, and he has been known to embellish many stories to appear as the common genius in the situation. In short, he was a genius, but he also wanted it to be known very well by others.