As I move through the document, I already have the location of the cursor origin saved in a register and can jump there, or any of several other locations with a single keypress.
I've always considered the mouse & menu system to be an emergency backup for beginners who have hit a wall. They will probably never be first class citizens.
What editor do you use?