Doesn't the 3090 cap out at 24GB VRAM? That's not a lot to run a local model
Both machines will be stuck in the 30-50GB model range, but the 3090 would have faster token prefill and faster decode speeds (614GB/s on M5 Max vs 936GB/s on 1x 3090).
That is not true.
3090 is only 24GB.
It will absolutely outperform the M5 on models that will fit in that space, but M5 will outperform with larger models as the whole 128GB is GPU addressable.