Of course. But von Neumann was just as human as the people who struggled to keep up with him, he just had different weaknesses. Having low emotional intelligence is every bit as deserving of understanding as having low general intelligence.
> The answer is to stop being around people. No community/culture/society owes anyone, not even people at this level, some kind of pampered sphere of existence that revolves around them.
You sure about that? Society has MASSIVELY benefited from von Neumann's work. If the cost of that was a few people's hurt feelings at his inability to interact with them a way that doesn't hurt their feelings it was a small price to pay.