Or like a m4 max? This thing has <300GB/s vs the max with 550GB/s
All those CUDA cores in the sparks but they're starved for memory bandwidth.
I am still waiting for NVidia to release a system that legit beats 3090 maxxing for the home gamer...
All those CUDA cores in the sparks but they're starved for memory bandwidth.
I am still waiting for NVidia to release a system that legit beats 3090 maxxing for the home gamer...
Spark:
OS: Windows/Ubuntu
Mbw: 300GB/s
Cuda cores: 6000
GPU accelerated containers: yes
M5 max:
OS: macOS
Mbw: 600GB/s
Cuda cores: 0
GPU accelerated containers: noThe sparks are good if your ultimate plan is to spend even more on NVidia hardware in future to run your dev setups at usable speeds. Or, you're developing for a work cluster.
If you mainly want to run local models at acceptable speeds portably, buy a mac with lots of RAM. If you’re happy with non-portable / racked, buy 3090s (dense) or mac studios (MoEs). Buy newer cards if you are restricted on power or slots. If you are rich, buy a6000 blackwells.