Hacker News Reader

Software wise there's plenty to choose from already. Ollama/llama.cpp, LM Studio, Lemonade, vllm etc. Anything Apple would bring to the table?

FWIW, Ollama, LM Studio and Lemonade (and oMLX) also wrap Apple's MLX framework.