Yeah, the mac minis can have up to 64GB of ram which would support some usable models. However, I accidentally got one with 24gb of ram, and my apps already use 12gbs. So, perhaps I'll get a second box just for LLMs!
It's a cool project. I might do it too. I have an M4 Mini sitting on my desk that I got for $550.