This is going to be catastrophic.
Whether AI works or is useful or not isn’t even the question anymore. It can fulfil every promise Sam Altman has been making and will still make no financial sense to justify these valuations.
Whether AI works or is useful or not isn’t even the question anymore. It can fulfil every promise Sam Altman has been making and will still make no financial sense to justify these valuations.
In summary, regardless of country of origin, availability of inference capacity is the moat protecting the likes of OpenAI and Anthropic, not technology superiority.
[1] https://www.fredgao.com/p/deepseeks-liang-wenfeng-breaks-his
It only justifies their long term valuations if they can leverage that temporary monopoly for technological superiority (they can't) or lasting market share (they can't).
Chinese models prove there's no technical advantage, and the software side is heavily commoditized so there's not much advantages to market share either.
The very exponential that you are relying on to give you runaway improvement is also giving exponentially increasing data to your competitors. All else being equal your competitors stay a step behind but you never develop a monopoly either. That's the best case for Anthropic/OpenAI. In reality, training data is just one variable, exponentials don't last forever, and your competitors will get better at capturing a bigger slice of training data.
a) indicative of problems that aren't already out there in the wild? (no) b) are the responses I'm getting so good and novel that the model can improve itself? (no)
It's the garbage in garbage out idea, just scaled up. If the model gave a bad answer, and I didn't catch it, and you now train on that I/O pair (my perhaps crappy prompt, the bad output), then you're not going to improve anything.
so, you know, they're as vulnerable as utilities at this point, if only there were people who gave a shit more about society than greed.
IMHO, this has the impact of softening the impact of data centers sitting unused in the long term if they can still serve open weight models, even if Anthropic or OAI have to scale down their expansion rate to pay the bills.
Regardless, reality has to give at some point; these valuations don't make any sense. We've been valuing GenAI as disruptive work, when in reality they're much closer to cloud providers with a beefy, one-pony-trick R&D department.
Is lack of inference chips due to the trading blocks by trump administration? What if Trump agrees to sell chips to china, would they collapse then? That's not a very strong position to be at
The report at [1] is a good summary of long term trends for China's rise in domestic self-sufficiency for semiconductor manufacturing. The report predicts "At current pace, China may achieve self-sufficiency in semiconductor manufacturing by 2027-2028, though trailing at leading-edge nodes". By contrast, before the first Trump presidency in 2017, a chart shows China importing 30% of all globally manufactured semiconductors (and increasing). Other reports on semiconductor fabrication equipment sales show the means, which is China having been and continuing to be in number (1) position for expenditure on semiconductor fabrication equipment.
The reports at [2] and [3] are also a good summary of long term trends for semiconductor foundry capacity predictions to 2031. A prediction is made that China's current 12% global semiconductor foundry supply capacity (across all semiconductor categories) in 2025 will expand to ~30% by 2031.
[1] https://www.yolegroup.com/product/report/china-semiconductor...
[2] https://www.yolegroup.com/product/report/status-of-the-semic...
[3] https://www.yolegroup.com/press-release/the-global-race-for-...
It’ll certainly take years but I would not bet against China’s ability to manufacture something.
When Xi Jinping did the announcement of their open weights push, they might as well cancelled their IPOs....
I close-out all my positions by end-of-trading everyday… so when the day came when there was a very clear and very scary indicator during early trading hours, quickly followed by SpaceX’s catastrophic fall right after opening bell, that was the end of my involvement….
And I fully expect oAI and anthro to be the same way. They’re being propped up with private loans, subsidies, and other tricky bookkeeping techniques. You would think their CEOs would pivot away from their current public personas. Ironically, they are like a poor man’s Elon Musk… and that doesn’t bode well for their companies
Second, humongous models are impractical even for them to deploy widely. They’re best used as teachers for smaller, more efficient models that can crank out the volume they need to sell.
Finally, there is a data wall. Sure, they can keep scaling RL on math problems and code. But with everything else, where will the supervision come from when they need several orders of magnitude more?
That's assuming the infrastructure needed to develop models stays available financially and supply wise. A lot of the services used to train and develop models are supplied and funded by people who are looking for multiple returns of investment. If/when OpenAI and Anthropic valuations fall and they inevitably get acquired, will Meta/Alphabet/Microsoft still want to spend lots of money for unclear returns in the short-term? Nvidia and co are on a one way train service to hype town. I don't think they will be happy to get on a coach to hype town Temu version. The shareholders likely won't.
Also, the backlash against LLMs is growing rapidly. AI content, data centres, etc is quickly gaining negative connotations outside of visual and music artists circles. While existing models are going nowhere, developing more advanced models is very quickly getting unpopular. LLMs Data centres increasing people's bills, Anthropic destroying old books, chat bots giving unethical advice to vulnerable people, etc. It won't be long before LLM infrastructure becoming an electoral issue.
Will a small research oriented community be big enough justify maintaining the apparatus needed to produce infra tech at a profitable level post OpenAI?
Many believe, including myself, that the market is currently propped by a massive AI bubble. Nearly a US $1 trillion is being spent this year, and more is planned for next year. All of this is for a "build up". There is no pay out. The major AI companies are taking in massive losses in the hopes that they will eventually be able to cash out.
The math is not looking good to me. The effect will be like the dotcom bubble. But much much bigger. Because the numbers are so much bigger.
Btw, the dotcom bust was real, but there was no dotcom bubble. Skeptics back then said that the valuations only made sense if tech companies were to dominate the economy in the future. Well, that future arrived more than a decade ago.
(More formally, if you had invested in a broad index of tech companies throughout the dotcom boom years, and had held this, you would have done reasonably well over the next twenty years.)
Also, take in consideration that the AI trade infected a lot of other trade in the economy, if you decide at some point to move your money to a place that is safe in case of a downturn be sure to carefully evaluate that’s actually the case
Compare and contrast how the dot-com bust did _not_ lead to global financial crises. Nor did Black Monday, nor the recent string of bank failures in the US.
('Manufactured' above means that central banks are responsible. I make no judgement on intent here. Around 2008 it was incompetence by the Fed and ECB as far as I can tell. The Fed started paying interest on excess reserves and the ECB even increased rates. Twice. Amongst quite a few other missteps.)