>I did change my keymap even further, so that arrow keys are mapped to fn+hjkl. This way, I can navigate everything just with hjkl (:

Yeah once you get used to vim way of working with text you can essentially never go back.