Okay, interesting. For such a small system I can imagine the jit compilation helps a lot.

Using Numba to jit compile the rhs might speed things up in the non-diffrax version.

Does the LSODA solver not take a minimum time step parameter? Setting that to your small fixed step might also help.