In 1954, Rex Rice wrote this piece about preferring a simple plugboard as the means of programming a computer, versus any sort of abstraction with a programming language (https://dl.acm.org/doi/10.1145/1455270.1455272). So it was still very much up for debate, whether high-level programming languages were even the right solution for the problems being faced.
But I agree with you, our forefathers were simply geniuses to have figured out how to manipulate the physical world to produce mathematical computations. Early in his career, my dad had to disassemble and reverse-engineer some Soviet-made aerospace devices, and he still fondly recalls how superbly engineered and precise the Soviet devices were. I wish there was more information out there about Soviet computing, but the winners do write history after all.