Just to confirm though - when you 'just click there', you're taking your hand off the keyboard, moving your arm and hand to the mouse, moving the mouse to the position you see, hopefully clicking exactly where you want to go on the first try, then returning your arm into position and hand on the keyboard, right?

Everyone should do what works for them, but with e.g. flash it takes 3 keypresses in most cases to go to any position I can see on the screen, without taking my hands off the keyboard. I was relatively late to Vim but I would never go back, even just for the improved physical ergonomics of not having to move my arm repetitively back and forth between mouse and keyboard.

It feels a little like people that swear that they can type perfectly well with 2 fingers - I have seen some very fast 2 finger typists, but in truth they're missing out on efficiency and comfort in the long run because they don't want to face the short-term pain of learning the better technique (and it is pain).