HNHacker News
TopNewBestAskShowJobs

advanced-stack

6 karma · joined September 23, 2023

submissionscomments
advanced-stack··on 2x Qwen 3.5 on M1 Mac: 9B builds a bot, 0.8B runs it
mmh.. interesting; I'll try to compare the perf
advanced-stack··on 2x Qwen 3.5 on M1 Mac: 9B builds a bot, 0.8B runs it
It's mostly a test of the coding capabilities of the 9B model. The 0.8B is used to make the telegram bot smarter than a if/then/else.

I find LM Studio more usable for local setups (desktop/laptop) and I would use directly llama.cpp stack for a (local) server deployment