There should at least be a code of professional conduct where authors state the extent to which LLMs were used. (This would also help not wasting time by asking some “authors” about “their” paper.)
Journals themselves should make policies about the extent to which they allow the use of LLMs. In some areas it might be considered more benign than in others.