When my girlfriend was conversing with an LLM in Czech, it often made grammatical mistakes or even switched into a different Slavic language (including ones that use the Cyrillic alphabet!).