That's interesting, I never knew that. I actually use Fish shell, and with my Colemak keyboard vi keybindings need to be remapped extensively (also why I don't use vim).
My solution to that issue is "just" alternate bindings which obsolete both the standard and vi navigation keys. At the home row, I have the arrow keys on my right hand and a "nav cluster" of my own devising (page up/down, tab left/right, workspace left/right) on the left.
Definitely not for everyone, but a possible way to have your cake and eat it too.