I'm predicting that the upcoming Mac Pro will be very popular among ML developers, thanks to unified memory.
It should be able to fit the entire model in memory.
Combine that with the fact that PyTorch recently added support for Apple silicon GPUs.
Combine that with the fact that PyTorch recently added support for Apple silicon GPUs.
apart from the fact that you can't use any of the many nvidia-specific things; if you're dependent on cuda, nvcuvid, AMP or other things that's a hard no.