It doesn't input and output letters. It's like if it communicated with a version of sign language. It's using all the same words but it has an arbitrary signal or two for each one.

So it can't spell for garbage because the tokenizer hides the real spellings from the LLM.