> Does this come up in practice? What kind of use cases suffer from disk latency?

One popular example is HFT.

And from my experience on a desktop PC it is better to disable swap and have the OOM killer do his work, instead of swapping to disk, which makes my system noticeable laggy, even with a fast NVMe.