More precisely, the RTX 5090 has a memory bandwidth of 1792 GB/s, while the DGX Spark only has 273 GB/s, which is about 1/6.5.
For inference, the DGX Spark does not look like a good choice, as there are cheaper alternatives with better performance.
For inference, the DGX Spark does not look like a good choice, as there are cheaper alternatives with better performance.
Then there's the Mac Studio, which outdoes them in all respects except FP8 and FP4 support. As someone on Reddit put it: https://old.reddit.com/r/LocalLLaMA/comments/1n0xoji/why_can...
The DGX seems vastly more capable.