(I have used both Acme and Emacs but only a little bit each) I can believe that most of the time it is easier to switch to the mouse to move the cursor where you want if it is no where near your current position. But what about just moving up and down one or two lines? Do you really just use Ctrl-A twice to go up a line? Or do you use the mouse? Or is there some alternative that I haven't heard yet?
http://acme.cat-v.org/keyboard
(oh and I really miss moving back and forth by word and incremental search with keyboard, I have nothing against using mouse for other things though)