Hacker News Reader

petrenk0non Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

For anyone who wants to try Bonsai 2 without setting up runtimes, downloading the right quant etc, try here - https://triangllabs.ai/otis

petrenk0non Otis – a minimal AI agent that runs local models out of the box

Hey HN! I've built Otis, an open-source ai agent that gives you one minimal experience across local and hosted open-weight models, privacy-focused by design.

On setup it recommends a local model based on the hardware Otis is running on, downloads it and runs it through llama.cpp for you. Ollama, LM Studio and Nvidia PAIR are supported too.

Hope it makes it easy to try and use open-weight models for some of you and all feedback is welcome!

petrenk0non Show HN: I built Otis, a minimal AI agent that runs local models out of the box

Appreciate the feedback!

Tbh Otis started as a personal TUI agent because I wanted something adapted to how I like to visualize things. Then from there it turned into the unified experience across local and hosted models to make it more accessible and intuitive for anyone. There is some overlap with Hermes but the interface is quite complex for most users.

I don’t believe in sacrificing functionality but at the same time you should not need to understand and learn model runtimes and harnesses etc. to use powerful AI successfully. Ollama and similar tools give users a bunch of models, options and settings to sift through but with Otis the focus is on simplicity, abstracting away the complexity to make getting right to work easy.

I agree though that I need to do a better job of communicating Otis’ differentiators. FWIW I am thinking about additional features to further simplify the experience, like automatic model routing.