I might just be over-caffeinated, but I would accidentally chord that all the time. I am continually bouncing up and down text when I am noodling on an idea.
In that scenario you’d already be in normal mode, no? It’s likely OP’s mapping is only for editing modes.