I think a lot of these are artifacts of RLHF and left-to-right thinking, and one might actually go away with diffusion LLMs. If anyone here spoke to Gemini Diffusion, does it have different speech patterns?
Not sure I'm happy about LLMS getting better... but it feels like an obvious improvement in both computational efficiency and training method.