I like this one: https://github.com/oobabooga/text-generation-webui

LLM is the swiss army knife for everyone not just developers.