yes thank you!
11 karma · joined July 11, 2026
So an iterator takes an immutable reference to the vector and mutation requires a mut ref, and you can't have both at the same time.
I use an 6bit quant and get around 20 tokens per second.
Are people really out there just mass copy pasting llm code without even trying to understand it! lol
You could get a much more powerful system for a lot less.