LLMs will by necessity but unintentionally enforce phonotactics but more at the sentence / thought level.