Tangentially related to what you ask: LLaMA tokenizer has fallback to byte-level tokens.