Tried this for quite some time now. The one part I find 100x more natural to do with the mouse is handling files and folders.

There's nothing quite like visually doing those things, and no worthwhile shell practice can quite compare.