Bit of a detail, but where are you deriving “with hundreds of terabytes of unified GPU memory” from?
But the point stands, these systems occupy a niche that Apple Silicon is poorly suited to filling. They run normal Linux, they support common APIs, and network to dozens of other machines using Infiniband.