I just added Llama 2 support to my LLM CLI tool: https://simonwillison.net/2023/Jul/18/accessing-llama-2/
So you can now access the Replicate hosted version from the terminal like this:
pip install llm
# or brew install simonw/llm/llm
llm install llm-replicate
llm keys set replicate
# Paste in your Replicate API key
llm replicate add a16z-infra/llama13b-v2-chat \
--chat --alias llama2
# And run a prompt
llm -m llama2 "Ten great names for a pet pelican"
# To continue that conversation:
llm -c "Five more and make them more nautical"
All prompts and responses are logged to a SQLite database. You can see the logs using: llm logs
This is using the new plugins mechanism I added to LLM last week: https://simonwillison.net/2023/Jul/12/llm/More on LLM here: https://llm.datasette.io/