If you don't use that letter for Vim it drops from the top 8 all the way to the bottom of the frequency chart (assuming you only type English). If you than map whatever J does in Vim to a more frequently used letter your typing speed should go up.
Alternatively since J seems to be used mostly for navigation (not sure, I don't use Vim) use the d-pad to do that instead.
---
> After I upgraded my gamepad to the DualShock4, I realized I could make diagonal inputs relatively accurately. Integrating diagonal inputs would reduce the number of more complex inputs required thus increasing speed.
Any plans to do that?