It feels like LLM progress in general has kinda stalled and we're only getting small incremental improvements from here.
I think we've reached peak LLM - if AGI is a thing, it won't be through this architecture.
I think we've reached peak LLM - if AGI is a thing, it won't be through this architecture.
Check this out from yesterday (watch the short video here):
https://simonwillison.net/2025/May/21/gemini-diffusion/
From:
That said, whether or not being a provider of these services is a profitable endeavor is still unknown. There's a lot of subsidizing going on and some of the lower value uses might fall to the wayside as companies eventually need to make money off this stuff.