Everyone misses the fact that ChatGPT's style is intentional, to make it obvious that ChatGPT wrote it.
Before RLHF they don't sound like that at all.
Before RLHF they don't sound like that at all.
Obviously this is all subjective, but OP implied it would be easier to make an LLM that doesn't sound like a stochastic parrot.