Hacker News Reader

You can fix looping with proper repetition penalties. Turn on the one called “DRY” that PeW invented and got merged into llama cpp

View on HN

I added repetition penalty of two. I do not know. Maybe it is not applied correctly somehow by llama swap, that I am using, but I do not consider it that much of a nuisance to so I did not tried to fix it yet.

Do you have this DRY docs?

Reply on news.ycombinator.com