“That said, GPUs are essential for training”
http://learningsys.org/neurips19/assets/papers/18_CameraRead...
http://learningsys.org/neurips19/assets/papers/18_CameraRead...
> Even without sparsification, AVX-512 CPUs are far more cost-effective for inference.