Hacker News Reader

Comment by sReinwald | Hacker News Reader

You can also set

    OLLAMA_CONTEXT_LENGTH=<tokens>

as an environment variable to change ollama's default context length.

I think that will not work if you use the OpenAI compatible API endpoint.

I tried this with ollama run, and it had no effect at all.

that env parameter is brand new, did you update ollama?