It'd be cool if someone could package this to be runnable with Nix, similar to https://community.flake.parts/services-flake/llm