It's even more primitive than, say, a mechanical calculator of that era, which yes, the NMC does have in a cabinet near the start. The Bombe isn't doing even simple arithmetic. It's essentially an electric motor, plus a lot of very complicated electrical wiring, to verify whether some particular setup (say, rotors I, V and IV in that order, set to JOM initially) could or could not ever cause the crib (a guess at some text an operator intended to send e.g. "Heil Hitler") to be converted into the ciphertext being attacked.
Each such setup is tried, very briefly, and if it couldn't be correct, the motor winds to the next, and the next and so on, until one setup which could be "Heil Hitler" is found. This is a "stop" - the machine literally stops until set going again. Women running the machine note down the exact setup which stopped it, and elsewhere very smart people try assuming this stop is correct - it might be, or, maybe the machine will stop again later, or, maybe the crib was wrong, maybe this message has a typo, "Heil Hiter"...
It's fantastically complicated but only in the same way that for example the movement of swallows is complicated. There's a relatively simple rule, it's just followed to an extreme degree and so that's impressive. It's not really very clever, and it's nothing like a computer.
Colossus isn't a programmable computer. It's for attacking Lorenz, so the people who built it didn't care that to attack a slightly different cipher the machine must be taken to pieces and re-assembled accordingly, they were here to attack Lorenz. In the rest of the early gallery there are several machines which are, or aren't, depending on how you squint truly programmable, truly electronics, truly storing the program and so on. But the Bombe is to these machines as the Super Bowl is to tennis. It's not that it's a very primitive and strange game of tennis, it's not tennis at all.