You don't need to setup LLM locally, the tool does that. You can choose which model to go with. It has Gemma and Qwen supported now.
Reply on news.ycombinator.com