Hacker News Reader

Comment by NortySpock | Hacker News Reader

If the local model is served via ollama, there's a default timeout of 10 minutes , which can be adjusted either per-call , or (as I did) in the systemd service environment variables

https://docs.ollama.com/faq#how-do-i-keep-a-model-loaded-in-...

You didn't specify what was serving your local model.

View on HN

Thank you for your reply. I use LM studio (local server), but can switch to a different tool.

Do you know how to switch it in LM studio?

What I see is that: android studio gives "Error: stream failed" and in LM studio server I see it is still working, then says that client (=android studio) disconnected.

So I assumed it was a setting in android studio.

Dunno, I have not used either of those. (Had been using zed and ollama, and ollama had plenty of odd defaults that needed fixing)

Glancing through the docs, I would be digging down in the config of both Android studio and lm studio for either a TTL or jit auto evict setting, and if you find it, set it to some large number measured in hours?

https://developer.android.com/studio/gemini/use-a-local-mode...

https://lmstudio.ai/docs/developer/core/ttl-and-auto-evict

I saw those and sadly none of those works not provides solution to "Error: stream failed" that happens like clockwork.

I found this one:

https://www.jetbrains.com/help/toolbox-app/remote-agent-time...

But it requires me to reinstall android studio because jetbrains toolbox cannot find it... because I installed ir on D:

On a side note Android studio atill creates hundred of megabutea of hidden stuff on C:

Reply on news.ycombinator.com