ZeroDP: Just-in-Time Weight Offloading over NVLink for Data Parallelism

mainlymatmul.com