Took me a while to find the lines, so here's the magic:
# ~/.config/mpv/input.conf (lines 20-22)
LEFT sub_seek -1
RIGHT sub_seek 1 # ~/.config/mpv/input.conf (lines 20-22)
LEFT sub_seek -1
RIGHT sub_seek 1Edit: sub_step is also great to adjust subtitle delay instead.