I couldn't test this because it fails to install on nixos inside a venv (some error with onnxruntime? when calling termax).

It seems fine, but I would appreciate a nixos package for this.

on the other hand, How is the LLM configured? Does it support llama etc...? Does it provide an automatic way to install the LLM?