It won't really help. You'll get the same issues with stiff DEs or ill-conditioned matrices for perfect precision or floating-point. There will be some cases where it will help, but not a lot.

I've implemented a few DE solvers and sparse matrix implementations before. I think sparse matrices is one case where it would help.