Who are these people that are designing systems that have terabytes of heap under a single GC, but still want/expect/need low pause times.

I would think if there were processes that needed consistent latency you would isolate them.