Having to click on something is different from being able to click on something. Vim doesn't let you use one of the two primary input tools of your computer--Sublime lets you use both.

To borrow your situation, if you are already using the mouse it's distracting to have to use the keyboard.