Apple is your savior if you are looking at it as a CPU/GPU/NPU package for consumer/hobbyists.
I decided that I have to start looking at Apple's AI docs
I decided that I have to start looking at Apple's AI docs
Apple will sell you a machine with 48GB of memory for thousands of dollars but plenty of people can't afford that, and even then the GPU is soldered so you can't just put four of them in one machine to get more performance and memory. The top end 40-core M4 GPUs only have performance comparable to a single A770, which is itself not even that fast of a discrete GPU.