Using pip to install a Large Language Model that's under 100MB
simonwillison.net
simonwillison.net
import llm
model = llm.get_model("SmolLM2")
model.prompt("Write me a poem about computers").text()
In the realm of computation, where magic is a thing of the past,
The digital realm, where the boundaries of what is thought,
The digital realm, where the boundaries of what is thought,
Someone suggested using it to build the world's worst calculator.
For the 'create_chat_completion' on this line: https://github.com/simonw/llm-smollm2/blob/afed0963b3a8bcca1...
I changed it to:
completion = model.create_chat_completion(
messages=messages,
temperature=0.2,
top_p=0.9,
presence_penalty=0.06,
frequency_penalty=0.5,
repeat_penalty=1.0,
)
And then added some to reduce repeating. I then used the prompt "Write a 10 line poem on computers." (note the fullstop), to get:
In the realm of computation, where magic and science intertwine,
The art of programming and the art of computing.
Computers are machines that can think, they are computers.
They can do what humans cannot – to create.
Computers are machines that can think, they are computers.
Computers are machines that think, they are computers.
Computers are machines that think, they are computers.
Computers are machines that think, they are computers.
Computers are machines that think, they are computers.
Computers are machines that think, they are computers.
Computers are machines that think, they are computers.
Computers can think, they can think.
Computers can be thought of as a machine that thinks.
Computers can be thought of as a machine that thinks.