the sweet spot is $9999 USD for 512GB unified memory

but that seems like an M5 maybe even M6

Currently its $5000 USD for 128GB on M3 I believe.

There just isn't anything good LLMs to run with current unified memory limits, especially 4090/3090s that can barely run anything special.

Many enterprises have bought m3s, setup their own sub 100gb VRAM gpu rigs but all in all report very little economic value being derived from it.

Even if local LLaMA's were as good as OpenAI or Anthropic, there is a disappointing lack of applications for it currently speaking with different users.

Curious to know if anybody has any counter anecdotes but really feels like AI winter is coming this winter.