You can get it for a lot less from https://frame.work
But 64G of VRAM is not the same as GPU mem, apples and oranges
But 64G of VRAM is not the same as GPU mem, apples and oranges
AMDs IGP are way less attractive because they use rather slow DDR4/5 memory while the M2 has blazing fast memory integrated in the package.
We're talking about 50 GB/s vs 400 GB/s. Nvidia's A100 has 1000 GB/s.
Memory bandwidth is usually the bottleneck in GPU performance as many kernels are memory-bound (look up the roofline performance model).
The Pro/Max have double/quadruple that bus width. But they are much bigger/more expensive chips.
I can find very little about it (or other 7000 series integrated gpus). Is this usable at all for running LLaMa in some way?