Where does Framework offer 64 GB of VRAM? By VRAM I am referring to GPU RAM, yes.
AMDs IGP are way less attractive because they use rather slow DDR4/5 memory while the M2 has blazing fast memory integrated in the package.
We're talking about 50 GB/s vs 400 GB/s. Nvidia's A100 has 1000 GB/s.
Memory bandwidth is usually the bottleneck in GPU performance as many kernels are memory-bound (look up the roofline performance model).
The Pro/Max have double/quadruple that bus width. But they are much bigger/more expensive chips.
I can find very little about it (or other 7000 series integrated gpus). Is this usable at all for running LLaMa in some way?