> LLMs spitting out GPL code seems perfectly inline with the spirit

Only if spitted out code is GPL-licensed, which it isn't.