Well, he did created the Von Newmann Architecture [1] and various other concepts that are still used in modern computers. So, I would say that his work is very influential in CS.

[1] https://en.wikipedia.org/wiki/Von_Neumann_architecture