Hacker News Reader

Comment by yunohn | Hacker News Reader

Super cool, congrats on the launch - will be trying this soon! I noticed it’s using Tauri - what are your main takeaways from building a local inference desktop app with it?

View on HN

Thanks. I learned that running a server on the Rust side and calling it from a TypeScript frontend is a good approach. For example, we run an OpenAI-compatible server using a Tauri plugin (https://github.com/fastrepl/hyprnote/tree/main/plugins/local...) and call it using the Vercel AI SDK.

I’ve been thinking about ways to reuse Vercel’s AI SDK, so this is a great one - thanks for sharing!

Also you might find this interesting:

https://github.com/fastrepl/hyprnote/blob/main/packages/util....

Super neat! You’ve made an impressive amount of cool specialized crates - have you considered making them generally usable to the wider community and licensing them under LGPL/MIT instead of GPL?

we def considered it. our line of thinking is start with more restrictive license, and later switch to MIT or something once we figure things out :)

I wanted to build this for myself. Could never figure out how to get audio output from Mac. Tried almost all audio loopback driver (Blackhole, Soundflower ...). There was problem everywhere wrt security.

Even tried making a teams meeting bot. But Teams doesn't give live audio to developer unless you are a special partner.

Glad you made this. Will play around

Great! We use AudioTap api

great to see that you like it :)

Reply on news.ycombinator.com