But made a local fork that works just as well with 'claude-code -p' and a local copy of ffmpeg
166 karma · joined September 11, 2018
But made a local fork that works just as well with 'claude-code -p' and a local copy of ffmpeg
This applies to pretty much everyone who isn't the US/China, no? I guess Russia also has a good amount of home grown web services (Yandex, Wildberries, etc), but not much in the AI space that I'm aware of.
Anyone else hack something together with HA / the Voice PE yet?
Looks like it needs a second model to do function calling, which gpt-realtime-2.5 didn't, and the Voice PE XMOS chip's audio pipeline might not be a great fit for full duplex back and forth, like what gpt-live-1 now supports.
Ever since getting over that, however, I've been extremely happy with Kagi. Couldn't recommend it more.
Curious for any more experiences
Responsibility and thoughtfulness? In this economy?
I wish the world would have gone down the route of banning social media in schools instead. But I guess that wouldn't create an execuse to de-anonymize the web :(
Best of luck over there!
It's a beautiful dashboard and proxy for monitoring models, requests, and API keys. It also supports routing rules, and ,proxy metrics, playground tabs, additional attribution headers, and much more. In addition to local models, it also supports proxying anthropic / openai requests from local coding agents like claude-code so you get much more insight into what they're doing too.
Currently relies on llama-swap / llama.cpp as the underlying inference engine, but that part is designed to be very generic and easy to swap out / build support for additional inference applications like ollama, vllm, etc. as long as they expose similar APIs.
It's entirely self-hostable without any cloud services. I'd love to hear any feedback you all may have!
I'll have to give the preserve_thinking a shot.
I've been working on an ops style tool for local LLM inference. Proxying, api keys, request logging, model rewriting and much much more.
Debating moving over to Fastmail as well
I understand if you want to stick with Firefox, but until Ladybird and co are ready for prime time, I'm sticking with Vivaldi.
This major release bump is a bit disapointing though. Was expecting some more headlining features than just a bit of a UI clean up.