Nvidia Shares Resume Fall
ft.com
ft.com
Of course, if the stock was overly inflated from false expectations, this could certainly be a resetting to the normal.
Also, I can't help but feel like DeepSeek is a red herring for the market overall. The stock market's overall dip didn't happen until after the slew of Executive Orders hit. The federal spending cuts are certainly going to affect the bottom line of businesses, and they add to the seriousness of some of the other anti-economic threats like tariffs.
Part of this recent selloff is going to be the bubble popping effect, but it's clear that inference will be the main demand driver, and that's something where ddr5 is competitive.
You may be rights but here is the other side. The AI/software/hardware/data center/energy trade got very crowed by levered money(Hedge funds).
1) That trade has had a huge run up lead by NVidia with alot of funds hedging their gains till the new year for tax reasons. They were al looking for a reason to sell and now could continue to lighten even more.
2) Nvidia is a large portion of the market right now. If you are a hedge fund that is measured against a US index then you probably have bitten the bullet and bought some NVidia exposure so you don't underperform if it continues its growth and the AI story fulfills its promise.
Now that NVidia is falling and you can make a story that it may under perform the market t his year you may see even more fast money dumping it as they no longer need to worry as much about it skewing market returns as much now.
3) if its true that you now need atleast an order of magnitude less power and chips to train a model then Nvidia was due to have a multiple decrease. This knocks onto the data center and power trades that also will have a multiple decrease on their pricing.
You may be right that this is an undeserved sell off, but given the recent growth it also seems like you can make the case that the whole trade got ahead of themselves and we were due a pull back to more properly value these companies earnings prospects.
One thing that is always useful to remember about the markets is that when you are priced for perfection like NVidia was, its signs that your long term growth may be slowing will affect your share price more than short term signs that your are doing what was expected of you.
No. I know people working on even tighter optimizations of LLMs. The magic is not in compute, its in design, and its feasible that once all the kinks are ironed out something akin to O1 could be run effectively on a Raspberry Pi; a whole GPU would yield much better results but it probably won't be necessary to buy 3, or 4, or a whole rack of them. Nvidia's stock prices soared on the expectation (from those who weren't in the know) that if massive amounts of capital were simply moved to the right places it continuously improve. The thing that drives tech forward is people, however, not capital.
I could see an "AI appliance" like the old Google Search Appliance: A single rack unit with a single $1000 GPU would probably be enough to run a pretty-robust DeepSeek style product, sold as "100% self-contained and on-prem, so you can trust it with propriatery data".
Sure, in a while demand will get back up. But by then maybe Nvidia will not be the only game in town anymore.
yeah for sure, but its an over reaction to an over reaction (the AI bubble and Nvidia's role in it)
For others, like me, it's important.
Purchased 50 call options Jan. 14, 2025
Why purchase another 5,000 shares Jan 14 if they have insider information they should sell?
They all build GPUs/TPUs that can run LLMs, correct?
You can also train Llama on TPU: https://cloud.google.com/tpu/docs/v5p-training
For inference, Nvidia's strengths seem to be not very important.
You can do inference on a single GPU. And AFAIK the software stack is not important for inference either. Because you don't have to experiment with the sofware. You just need to get it to run and then you will run it for a long time unchanged. Groq for example runs LLAMA on their custom hardware, correct?
And I expect hardware for inference to become a bigger market than hardware for training.
https://xcancel.com/carrigmat/status/1884244369907278106
The only reason you need all those GPUs is because they only have a fraction of the ram you can cram in a server.
With AMD focusing on ram channels and cores the above rig can do 6-8 tokens per second inference.
The GPUs will be faster, but the point is inference on the top deepseek model is possible for $6k with an AMD server rig. 8 H200's alone would cost $256,000 and gobble up way more power than the 400 watt envelope of that EPYC rig.
It used to stress me out, until I realized that I could profit off the volatility.
I don't think this is an effect of the bubble bursting. This week it swung from Friday closing around $148 to this week bottoming out at $118. Currently it's trading at $121 which is fairly normal for its range within the last 3 months. It's been averaging around $120-135 for the last 3 months. I know because I trade on it weekly. The sudden "investor confidence" is mostly the excitement of the AI super investment by Trump, hence the valuation up to $148 (Wish I had a sell order at 145 not 150, I would be in the money so much).
Even in the most optimistic case, I find it hard to imagine that nvidia alone captures much more than 1% of the US GDP as profits for the next 20 years or whatever their investor's horizon is.
I'd even agree with that argument, I just don't think it's the one you're making.
I don't have the numbers, but I wonder how "internet company" (very loosely) profits compare to GDP - I could imagine the AI ecosystem reaching similar profits eventually.
Btw, imo their P/E is mostly this good because they're currently selling hardware at margins better than many software companies, I doub that this will/can last. For example, when FB/MS each are spending $50B+/a on GPUs, can they justify say $100M/a on a crack software dev team to make their stack work on other GPUs (ie replace the oft-argued CUDA moat within a year or two)?
But yeah, absurdity:10 does not mean insincere!
Best of luck (you'll absolutely need luck, because that's a stupid move).