I spent lots of time on this topic, and had a similar path. Meanwhile the tool also supports a quick way to add custom or local providers to agents: https://vibepod.dev/news/vibepod-cli-0-24/
90 karma · joined May 29, 2023
I build open-source tools for developer workflows. Currently working on VibePod, which runs AI coding agents in Docker or Podman containers with traffic logging and local analytics. I also work on VoiceVault (conversation transcription and summaries) and SnyPy (a self-hosted code snippet manager).
Interested in Python, APIs, self-hosting, local LLMs, and understanding what coding agents actually do.
Blog: https://nezhar.com/ GitHub: https://github.com/nezhar VibePod: https://vibepod.dev/
I spent lots of time on this topic, and had a similar path. Meanwhile the tool also supports a quick way to add custom or local providers to agents: https://vibepod.dev/news/vibepod-cli-0-24/
Workers and Boards are in the making
Anybody here succeed to run this on AMD?
Or do you mean something else?
Free for two weeks on OpenRouter https://openrouter.ai/tencent/hy3:free
You don't have any guarantees in terms of data, that's true, you rely on the provider. But this is similar to a database or other services where you don't have the knowledge or resources to run them yourself. Hardware cost is an additional factor here.
If on the other hand your idea works out and the model fits the use case, you can always decide to move to a dedicated infrastructure later.