In other comments people mention the "flywheel" of data and money feeding training, but there's a view that at some point the baseline open-weight models are "good enough" that the money will dry up.
baseline open-weight models are "good enough" that the money will dry up.
I take a different view. Open-weight models aren't going to be free forever. At some point, open weight model labs will also have to make money.My guess is that the industry will consolidate. The winners will absorb the losers and focus on generating revenue.
Therefore, there will be a growing gap between open and free models and the proprietary SOTA models.
If there is consolidation by absorption, that derisks attempting to challenge the SOTA providers, and so they will keep facing attempts.
The ones that are already released are, and they're already very good for most purposes and can be fine-tuned indefinitely, includin months or years down the line when processes have been optimized and things aren't as compute-heavy as they are now.
And the fact that the open-weight as well as cheaper tier 2 offers exist both place a ceiling on the prices the SOTA companies can demand - and as far as we know current prices don't even fully pay for inference alone already, at least not for OpenAI.
It's not clear. Z.ai is definitely not profitable.
ARR is not a moat at all, because the revenue of OpenAI is not preventing Alibaba, z.ai and so on from generating revenue as well. The opposite is true, actually, because the first mover prepared the market (e.g. user education about application possibilities, creating the willingness to pay for the service in the first place) for the second movers.
People here write about switching from Claude to Codex mid-workday - that is the absolute opposite of a moat.
The only companies that have a chance of not losing everything in this market are those with established non-AI revenue streams, like Google or Alibaba, or those focusing on profitability in niche markets instead of participating in the SOTA death race.
It’s all a game until the music stops.
A moat is protection so you can keep your ARR up or increase it over years. Arguably only google have a moat with their TPUs. NVidia has a moat. But the others who just train some models on NVidia hardware have no moat.