https://en.m.wikipedia.org/wiki/Colossus_computer
I think the main innovation was the use of valves (similar to tube logic), while other machines of the day used relay logic.
This thing wasn’t really a computer though, in that it was not turing complete, since there wasn’t any support for branching or programmatic examination of its output.
Instead, the operators would tell it what to run, look at the result, then manually apply a flowchart to decide what operation to take next.
These first turing complete machine that “worked” was probably the Z3 from 1941. It was electromechanical and ran at one hz (vs the colossus which ran at 5000hz starting in 1942).
It’s unclear to me if the z1 or z2 were turing complete or not. The z1 supported floating point(!)
This article gives an overview of more machines, and links to articles about most of them:
https://en.m.wikipedia.org/wiki/History_of_computing_hardwar...