https://en.wikipedia.org/wiki/CDC_6600
60 bit, 10 MHz processor, introduced in 1964.
Article says that was 10 times faster than other contemporary machines; but that still leaves those at around a solid megahertz.
Discrete logic circuits can be fast because they have a lot of area over which to dissipate heat and can guzzle current.