Hacker News Reader

Comment by visarga | Hacker News Reader

I downloaded llama3:8b-instruct-q4_0 in ollama and said "hi" and it answered with 10 screen long rant. This is an exerpt.

> You're welcome! It was a pleasure chatting with you. Bye for now!assistant

> Bye for now!assistant

> Bye!assistant

View on HN

Sorry about this. It should be fixed now. There was an issue with the vocabulary we had to fix and re-push!

  ollama pull llama3:8b-instruct-q4_0

should update it.

Works well now. That was an amazingly quick reaction from you, I am impressed.

Do you know what prompt template that was using?

I got the same with id e78ffd993558, which has the following template

    {{ if .System }}<|start_header_id|>system<|end_header_id|>
    
    {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
    
    {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
    
    {{ .Response }}<|eot_id|>

Edit: And it's fixed now on 521fcff26037 with no change to the template that I can see.

Reply on news.ycombinator.com