Tim Dettmers is such a star. He's probably done more to make low-resource LLMs usable than anyone else.

First bitsandbytes[1] and now this.

[1] https://github.com/TimDettmers/bitsandbytes