Why is it controversial? I know nothing of Von Neumann, but it doesn't seem like a bad thing. "Coziness" could mean a lot of things, but personally even if Von Neumann was taking the military industrial complex out on a date every Tuesday, I wouldn't see a problem with it.
Is the implication that the military was influencing his integrity as a scientist?
The bigger criticism of Von Neumann is that he set back quantum mechanics for a few decades: https://twitter.com/orzelc/status/1446414513465696256
EDIT: There's a shocking comment further downthread. https://news.ycombinator.com/item?id=28811713
I retract my claim that the bigger criticism was his treatment of QM. The bigger criticism is that Von Neumann was a lunatic – I try not to call names, but advocating the extermination of a population is the dealbreaker threshold of niceness for me.