You could, in fact, dial them one-handed. A rotary phone uses pulse dialing; as the rotor turns it opens the circuit briefly, if you dial 5 it sends 5 pulses. So you can do the same by pushing the switch repeatedly and pausing in between each number as though the rotor was spinning back.
Same trick works on touch tone phones since the networks still support pulse dialing.