Great repo, but there was this for openAI which was bit hard to find: https://github.com/cogentapps/chat-with-gpt/blob/main/app/sr....
Not completely sure, but I think it will likely work as it is for llama as both are BPE following same rules.
Not completely sure, but I think it will likely work as it is for llama as both are BPE following same rules.