it's literally the same technology as LLMs. Transformers were proposed for translation.

(But I don't know what methods the Firefox translation uses. I assume it's a local model but don't even know that for sure.)