Mac Studio M5 Max review: The best reason to run AI locally
tbreak.com
tbreak.com
I wouldn't be surprised if there were (llm) models tuned specifically for this size of memory, MOE of course, the Mac doesn't do the dense variety very well. Still, there's a lot that can be done with MOE.