Neat. Now release 48gb GPUs to the hobbyist devs and we’ll use intel for LLMs!
I decided that I have to start looking at Apple's AI docs
Apple will sell you a machine with 48GB of memory for thousands of dollars but plenty of people can't afford that, and even then the GPU is soldered so you can't just put four of them in one machine to get more performance and memory. The top end 40-core M4 GPUs only have performance comparable to a single A770, which is itself not even that fast of a discrete GPU.