Samsung's 60% DRAM price hike signals a new phase of global memory tightening
buysellram.com
buysellram.com
128GB used to be 400$ in June, and now it's over $1,000 for the same 2x64GB set..
I have no idea if/when prices will come back down but it sucks.
(That's just me eyeballing it, feel free to do the math)
Also worth mentioning DRAM and NAND's profit from Samsung is what keep the Samsung Foundry fighting TSMC. Especially for those who thinks TSMC is somehow a monopoly.
Another things to point out which is not mentioned yet, China is working on both DRAM and NAND. Both LPDDR5 and Stacked NAND are already in production and waiting for yield and scale. Higher Price will finally be perfect timing for them to join the commodity DRAM and NAND race. Good for consumer I suppose, not so good for a lot of other things which I wont go into.
Unfortunately commodity business is not sexy, it doesn't get the press, nor does it get told even in business schools. But a lot of the times these call called price fixing is a natural phenomenon.
I wont even go into what get decided in court doesn't always mean it is right.
I will also add we absolutely want the DRAM and NAND or in fact any industries to make profits, or as much profits as it could. What is far more important is where do they spend not those profits. I didn't look into SK Hynix but both Samsung and Micron spends significant amount of R&D at least try to lower the total production cost of DRAM per GB. We want them to make healthy margin selling DRAM at $1/GB, not losing money and then go bankrupt.
The firms can coordinate by agreeing on a strategy they deem necessary for the future of the industry, and that strategy requires significant capital expenditures, and the industry does not get (or does not want) outside investment to fund it, and if any of the firms defects and keeps prices low the others cannot execute on the strategy, so they all agree to raise prices.
Then, after the strategy succeeds, they have gotten addicted to the higher revenues, they do not allow prices to fall as fast as they should, their coordination becomes blatantly illegal, and they have to get smacked down by regulators.
https://www.tomshardware.com/pc-components/storage/perfect-s...
Do we really think the current level of AI-driven data center demand will continue indefinitely? The world only needs so many pictures of bears wearing suits.
In a traditional pork cycle there's a relatively large number of players and a relatively low investment cost. The DRAM market in the 1970s and 1980s operated quite similarly: you could build a fab for a few million dollars, and it could be done by a fab which also churned out regular logic - it's how Intel got started! There were dozens of DRAM-producing companies in the US alone.
But these days the market looks completely different. The market is roughly equally divided up between SK Hynix, Micron, and Samsung. Building a fab costs billions and can easily a year of 5 - if not a decade - from start to finish. Responding to current market conditions is basically impossible, you have to plan for the market you expect years from now.
Ignoring the current AI bubble, DRAM demand has become relatively stable - and so has the price. Unless there's a good reason to believe the current buying craze will last over a decade, why would the DRAM manufacturers risk significantly changing their plans and potentially creating an oversupply in the future? It's not like the high prices are hurting them...
Will the company be evicted from the country in 6 months? A year? Will there be 100% tariffs on competitions imports? Or 0%? Will there be an anti-labor gov’t in effect when the investment might mature, or a pro-labor?
The bigger the investment, the longer the investment timeframe, and the more sane the returns - the harder it is to make the investment happen.
High risk requires a correspondingly high potential return.
That everyone has to pay more for current production is a side effect of the uncertainty, because no one knows what the odds are of even future production actually happening, let along the next fancy wiz-bang technology.
But people do need the current production.
Nobody is going to do anything if they can't be sure that they'll be able to run the fab they built for a long time and sell most of what they make. Conversely fabs don't tend to idle a lot. Sometimes they're only built if their capacity is essentially sold already. Given how massive the AI bubble is looking right now, I personally wouldn't expect anyone to make a gamble building a new fab.
* Someone explained this at length on here a while ago, but I can't seem to find their comment. Should've favorited it.
Following your reasoning, which is common in manufacturing, the capex needed is already allocated. So, where does the 2x price hike come from if not supply/demand?
The cost to produce did not go up 100%, or even 20%
Actually, DRAM fabs do get scaled down, very similar to the Middle East scaling down oil production.
"Hyperscalers" already have multi-year contracts going. If the demand really was there, they could make it happen. Now it seems more like they're taking capacity from what would've been sold on the spot or quarterly markets. They already made their money.
It's kinda sad when you grow up in a period of rapid hardware development and now see 10 years going by with RAM $/GB prices staying roughly the same.
That period of time had some benefits. Programmers learned to squeeze absolutely everything out of that hardware.
Perhaps writing software for today's hardware is again becoming the norm rather than being horribly inefficient and simply waiting for CPU/GPU power to double in 18 months.
I was lucky. I built my am5 7950x Ryzen pc with 2x48gb ddr5 2 years ago. I just bought 4x48gb kit a month ago with an idea to build another home server with the old 2*48gb kit.
Today my old g.skill 2x48gb kit costs Double what I paid for the 4x48gb.
Furthermore I bought two used rtx3090 (for AI) back then. A week ago I bought a third one for the same price... ,(for vram in my server).
I put my G4 PowerBook into it once, and then vowed never to look at it again.
But you’re cherry picking prices from a notable period of high prices (right now).
If you had run this comparison a few months ago or if you looked at averages, the same RAM would be much cheaper now.
We’re just consuming a lot of DRAM in general.
A house is $500,000
A GPU is $500
You could put GPUs into the inflation bucket and it wouldn’t change anything. Inflation trackers count cost of living and things you pay monthly, not one time luxury expenses every 4 years that geeks buy for entertainment.
Same order, same bill of materials, 17.5K USD per unit today.
That is roughly a 5.5k increase for 768GB of DDR5 ECC memory and the 4 2tb nvme ssds.
Really wish that I could replace my old skylake-x system but even ddr4 rdimms for an older xeon are crazy now let alone ddr5. Unfortunately I need slots for 3xTitan V's for the 7.450 TFLOPS each of FP64. Even the 5090 only does 1.637 TFLOPS for FP64, so just hopping that old system keeps running.
Upgraded by adding 64GB.. last Friday I sold the 32 GB I took out for what I paid for the 64 GB in July... insane
(Including the submitter. In their comment history is "Tip: You can sell used server RAM or desktop modules through BuySellRam to recover value from old hardware." at https://news.ycombinator.com/item?id=45800881 and all of the submissions of this domain are from this user: https://news.ycombinator.com/from?site=buysellram.com )
Old RAM that comes out of the PCs being sold at fire sale prices isn’t really in demand though. Even slower DDR4 grades aren’t seeing much demand.
Actually, the textile market is pretty volatile in the US these days with Joan's out of business. Pick a poison, I guess? There's little room for stability in a privately-owned-world.
Close a few Chrome tabs, and save some DDR5 for the rest of us. :-)
It depends. It takes more energy, which can be undesirable in battery powered devices like laptops and phones. Higher end memory can also generate more heat, which can be an issue.
But otherwise more RAM is usually better. Many OS's will dynamically use otherwise unused RAM space to cache filesystem reads, making subsequent reads faster and many databases will prefetch into memory if it is available, too.
$ ~/dev/mozlz4-tool/target/release/mozlz4-tool \
"$(find ~/Library/Application\ Support/Firefox/Profiles/ -name recovery.jsonlz4 | head -1)" | \
jq -r '[.windows[].tabs | length] | add'
5524
Activity monitor claims firefox is using 3.1GB of ram. Real memory size: 2.43 GB
Virtual memory size: 408.30 GB
Shared memory size: 746.5 MB
Private memory size: 377.3 MB
That said, I wholeheartedly agree that "more RAM less problems". The only case I can think of when it's not strictly better to have more is during hibernation (cf sleep) when the system has to write 128GB of ram to disk.However this does not make sense, as for more than a decade the processors have only grown increasing the number of threads, therefore two channels sounds like a negligent and deliberately imposed bottleneck to access the memory if one use all those threads (Lets say 3D render, Video postproduction, Games, and so on).
And if one want four channels to surpass such imposed bottleneck, the mainboards that nowadays have four channels don't contemplate consumer use, therefore they have one or two USB connectors with three or four LAN connectors at prohibitive prices.
We are talking about consumer quad-channel DDR4 machines ten years old, wildly spread, keeps being competent compared with current consumers ones, if not better. It is like if all were frozen along this years (and what remains to be seen with such pattern).
Now it is rumoured that AMD may opt for four channels for its consumer lines due to the increased number of pin connectors (good news if true).
It is a bad joke what the industry is doing to customers.
RAM uses power.
If you are working on an application that has several services (database, local stack, etc.) as docker containers, those can take up more memory. Especially if you have large databases or many JVM services, and are running other things like an IDE with debugging, profiling, and other things.
Likewise, if you are using many local AI models at the same time, or some larger models, then that can eat into the memory.
I've not done any 3D work or video editing, but those are likely to use a lot of memory.
You're welcome.
Usually after the companies are fined for price-fixing
When the AI bubble bursts we can get back to the old price
If those retailers didn’t increase their prices when the price hike was announced, anyone building servers would have instantly purchased all of the inventory anyway at the lower prices, so there wouldn’t actually have been weeks of low retail RAM prices for everyone.
Every once in a while you can catch a retailer whose pricing person missed the memo and forgot to update the retail price when the announcement came out. They go out of stock very rapidly.
But that retailer would have made a lot of money in a very short time.
No matter what, you are not getting those modules at the old price. There are few things that trip up people harder than this exact scenario, and it happens everywhere. Concert tickets, limited releases, water during crises, hot Christmas gift, pandemic GPUs, etc.
Once understood you can stop getting mad over it like it's some conspiracy. It's fundamental and natural market behavior.
Years, or when the AI bubble pops, whatever comes first.
Similar situation with QLC flash and HDDs btw.
Those price increases are not normal at all. I understand that most of it still comes from market demands but this is also skewing the market now in unfair manners. Such increases smell of criminal activity too.
You want to penalize companies for buying things and penalize companies for selling things are market rate?
There are a lot of good examples through history about how central planning economics and strict price controls do not lead to good outcomes. The end result wouldn’t be plentiful cheap RAM for you. The end result would be no RAM for you at all because the manufacturers choose to sell to other countries who understand basic economics.
Building a PC in a cost efficient manner generally requires someone to track parts prices over years, buy parts at different times, and buy at least a generation behind.
The same applies to many other markets/commodities/etc...
- the insane frothing hype behind AI is showing me a new kind of market failure - where resources can be massively misallocated just because some small class of individuals THINK or HOPE it will result in massive returns. Even if it squeezes out every single other sector that happens to want to use SDRAM to do things OTHER than buffer memory before it's fed into a PCIE lane for a GPU.
- I'm really REALLY glad i decided to buy brand new gaming laptops for my wife and I just a couple months ago, after not having upgraded our gaming laptops for 7 and 9 years respectively. It seems like gamers are going to have this the worst - GPUs have been f'd for a long time due to crypto and AI, and now even DRAM isn't safe. Plus SSD prices are going up too. And unlike many other DRAM users where it's a business thing and they can to some degree just hike prices to cover - gamers are obviously not running businesses. It's just making the hobby more expensive.
There's too much group-think in the executive class. Too much forced adoption of AI, too much bandwagon hopping.
The return-to-office fad is similar, a bunch of executives following the mandates of their board, all because there's a few CEOs who were REALLY worked up about it and there was a decision that workers had it too easy. Watching the executive class sacrifice profits for power is pretty fascinating.
Edit: A good way to decentralize the power and have better decision making would be to have less centralized rewards in the capital markets. Right now are living through a new gilded age with a few barons running things, because we have made the rewards too extreme and too narrowly distributed. Most market economics assumes that there's somewhat equal decision making power amongst the econs. We are quickly trending away from that.
At least before there was a certain common baseline derived from everyone watching the same news and reading the same press. Now they are just as enclosed in their thought bubbles as everyone else. It is entirely possible for a tech CEO to have a full company of tech workers despising the current plan and yet that person being constantly reinforced by linkedin and chatgpt.
I remember first hearing the phrase "yes man" in relation to a human ass kisser my dad worked with in like 1988.
It's very easy to unknowingly surround yourself with syncophants and hangers on when you literally have more money than some countries. This is true now and has been true forever. I'm not sure they're more out of touch, as much as we're way more aware?
Perhaps a better approach to anti-monopoly and anti-trust is possible, but I'm not sure anybody knows what that is. Khan was very well regarded and I don't know anybody who's better at it.
Another approach would be a wealth and income taxation strategy to ensure sigmoid income for the population. You can always make more, but with diminishing returns to self, and greater returns to the rest of society.
Well, assuming they haven't revived the cartel.
I think this is actually the long tail of "too big to fail." It's not that they're all thinking the same way, it's that they're all no longer hedging their bets.
> we have made the rewards too extreme and too narrowly distributed
We give the military far too much money in the USA.
I don't think there is even a good solution for that. Govt could essentially sponsor some competition but that's easy to go from "helping to market" to "handouts for incompetent"
~ themafia, 2025
(sorry)
On a more serious note the military is sure a money burning machine, but IMHO it's only government spending, when most of the money in the US is deliberately private.
The fintech sector could be a bigger representation of a money vacuuming system benefiting statistically nobody ?
In theory I guess this creates a demand that should be satisfied by the market but in reality it seems like when the wealth is too concentrated in the hands of the few that call all the decision the market is unable to act.
But the power concentration is a strong reason. That level of wealth is incompatible with democracy. Money is power, and when someone accumulates enough of it to be able to personally shake entire industries, it's too much.
A centralized authority capable of so severely restricting the economic freedom of the most powerful people implies a far greater concentration of power than the one you're fighting against. You're proposing to cure the common cold with AIDS.
But yeah in the end companies behave in trends, if some companies do it then the other companies have to do it too, even if this makes things less efficient or is even hurtful. We can put that onto the human factor, but I think even if we replaced all CEOs with AIs, those AIs would all see the same information and make similar decisions on those information.
There is pascal's wager arguments to be had: for each individual company, the punishment of not playing the AI game and missing out on something big is bigger than the punishment of wasting resources by allocating them towards AI efforts plus annoying customers with AI features they don't want or need.
> Right now are living through a new gilded age with a few barons running things, because we have made the rewards too extreme and too narrowly distributed.
The usa has rid itself multiple times of its barons. There is mechanisms in place, but I am not sure that people really are going to exercise those means any time soon. If this AI stuff is successful in the real world as well, then increasing amounts of power will shift away from the people to the people controlling the AI, with all the consequences this has.
The only saving grace is that it can die and others will scoop up released resources.
When country level planned economy dies, people die and resources get destroyed.
Ideally. Realistically in market with only few companies around it makes it even less competitive.
This is confused. Here is how classical economists would frame it: a firm chooses how much to produce based on its cost structure and market prices, expanding production until marginal cost equals marginal revenue. This is price guided production optimization, not central planning.
The dominant criticism of central planning is trying to set production quantities without prices. Firms (generally) don’t do this.
It's a form of "centralized planning", except it's not centralized at all.
No, it's pure capitalism where Atlas shrugged and ordered billions worth of RAM. You might not like it but don't call it "centralized planning" or "Soviet era".
We have been living on the investment of previous centuries and decades in the West for close to 40 years now. Everything is broken but that didn't matter because everything that needed a functioning physical economy had moved to the East.
AI is the first industrial breakthrough in a century that needs the sort of infrastructure that previous industrial revolutions needed: namely a ton of raw power.
The bubble is laying bare just how terrible infrastructure is and how we've ignored trillions of maintenance to give a few thousand people tax breaks they don't really need.
All the infrastructure will be useless when the data centers move to the next city/state offering a tax cut.
Is it?
The British didn't industrialise Indian for a reason.
This resonates deeply, especially to someone born in the USSR.
You can blame irrational exuberance, bubbles, or whatnot markets are ultimately individual choices times economic power. Ai, Crypto, housing, Dotcom etc going back through history all had excess because it’s not obvious when to join and when to stop.
If it was a couple billion dollars of memory purchasing nobody would care.
It happens more often than you might expect.
The Onion Futures Act and what led to it is always a fun read: https://en.wikipedia.org/wiki/Onion_Futures_Act
Except that these corporations will almost certainly get a bail out, under the auspices of national security or some other BS. The current admin is backed by the same VCs that are all in on AI.
It's a little ironic but to call this a market failure due to resource misalocation because prices are high when high prices is how misalocation is avoided.
I'm a little suspicious that "misalocation" just means it's too expensive for you. That's a feature, not a bug.
That's basically what the rich usually do. They command disproportionate amount of resources and misallocate them freely on a whim, outside of any democratic scrutiny, squeezing incredible number of people and small buisness out of something.
Whether that's a strength of the system or the weakness, I'm sure some rearch will show.
The only way the massive planned investments make sense is if you think the winner can grab a very large piece of a huge pie. I've no idea how large the pie will be in the near future, but I'm even more skeptical that there will be a single winner.
The more I dream about the possibilities of AR, the more I believe people are going to find it incredibly useful. It's just the hardware isn't nearly ready. Maybe I'm wrong but I believe these companies are making some of the largest strategic blunders possible at this point in time.
Technically speaking, this is not a market failure. [1] Why? Per the comment above, it is the individuals that are acting irrationally, right? The market is acting correctly according to its design and inputs. The market’s price adjustment is rational in response. The response is not necessarily fair to all people, but traditional styles of neoclassical economic analysis deaccentuate common notions of fairness or equality; the main goal is economic efficiency.
I prefer to ask the question: to what degree is some particular market design serving the best interest of its stakeholders and society? In democracies, we have some degree of choice over what we want!
I say all of this as a person who views markets as mechanisms not moral foundations. This distinction is made clear when studying political economic (economics for policy analysis) though I think it sometimes gets overlooked in other settings.
If one wants to explore coordination mechanisms that can handle highly irrational demand spikes, you have to think hard. To some degree, one would have to give up a key aspect of most market systems — the notion of one price set by the idea of “willingness to pay”.
[1] Market failure is a technical term within economics meaning the mechanism itself malfunctions relative to its own efficiency criteria.
There are potentially undesirable tradeoffs and a whole new game of cheats and corruption, but you could frustrate rapid, concentrated growth with things like an increasing tax on raised funds.
Right now, we basically let people and companies concentrate as much capital as they want, as rapidly as they want, with almost no friction, presumably because it helped us economically outcompete the adversary during the Cold War. Broadly, we're now afraid of having any kind of brake or dampener on investments and we are more afraid of inefficiency and corruption if the government were to intervene than we are of speculation or exploitation if it doesn't.
In democratically regulated capitalism, there are levers to pull that could slow down this kind of freight train before it were to get out of control, but the arguments against pulling them remain more thoroughly developed and more closely held than those in favor of them.
Care to share some keywords here?
Yeah I know HN is going to hate me for saying that.
If a big company and a few small companies all have identical costs for producing a product, society is better served by having it produced by the few small companies than the one big company.
Once "better served" is quantified, you know the coefficient for taxation.
Make no mistake, this coefficient will be a political football, and will be fought over, just like the Fed prime interest rate. But it's a single scalar instead of a whole executive branch department and a hundred kilopages of regulations like we have in the antitrust-enforcement clusterfuck. Which makes it way harder to pull shenanighans.
Why? That's exactly the circumstances where the mere potential for small companies to pop up is enough to police the big company's behavior. You get lower costs (due to economies of scale) and a very low chance of monopolization. so everyone's happy. In the case of this DRAM/flash price spike, the natural "small" actors are fabs slightly off the leading edge, that will be able to retool their production and supply these devices for a higher profit.
If that were true, "you're in Amazon's kill zone" wouldn't be something VC's say to startups. And yet, they do say that.
How so? Costs will be higher with multiple small products, resulting in higher costs for customers. That's the opposite of "society is served better".
We draw the line at monopolies, which makes sense.
well, assuming the scale couldn't be used for the benefit of society and not to milk it dry. but yes probably the best that can have a reasonable chance at success, eventually, maybe.
Unfortunately, that doesn't seem to be the flavor of politics on tap at the moment.
Sam Altman cornering the DRAM market is a joke, of course, but if the punchline is that they were correct to invest this amount of resources in job destruction, it's going to get very serious very quickly and we have to start making better decisions in a hurry or this will get very, very ugly.
maybe AI cures cancer, or at least writes some code
The tone from the AI industry sounds more like a dependent addict by comparison. They're well past the phase where they're enjoying their fix and into the "please, just another terawatt, another container-ship full of Quadros, to make it through the day" mode.
More seriously, I could see some legitimate value in saying "no, you can't buy every transistor on the market."
It forces AI players to think about efficiency and smarter software rather than just throwing money at bigger wads of compute. This might be part of where China's getting their competitive chops from-- having to do more with less due to trade restrictions seems to be producing some surprisingly competitive products.
It also encourages diversification. There is still no non-handwavey road to sustainable long-term profitability for most of the AI sector, which is why we keep hearing answers like "maybe the Extra Fingers Machine cures cancer." Eventually Claude and Copilot have to cover their costs or die. If you're nVidia or TSMC, you might love today's huge margins and willing buyers for 150% of your output, but it's simple due diligence to make sure you have other customers available so you can weather the day the bubble bursts.
It's also a solid PR play. Making sure people can still access the hobbies they enjoy is an easy way to say you're on the side of the mass public. It comes from a similar place to banning ticket scalping or setting reasonable prices on captive concessions. The actual dollars involved are small (how many enthusiast PCs could you outfit with the RAM chips or GPU wafer capacity being diverted to just one AI data centre?) but it makes it look like you're not completely for sale to the highest bidder.
I see people using "market failure" in weird ways lately. Just because someone thinks a use for a product isn't important, doesn't mean it's a market failure. It's actually the opposite - consumers are purchasing it at a price they value it.
Someone who doesn't really need 128GB of ram won't pay the higher cost, but someone who does need it will.
Currently we are still at the stage of extraction from the upper/middle class retail investors and pension funds being sucked up by all the major tech companies that are only focused on their stock price. They have no incentive to compete, because if they do, it will ruin the game for everyone. This gets worse, and the theory (and somewhat historically) says it can lead to war.
Agree with the analysis or not, I personally think it is quite compelling to what is happening with AI, worth a watch.
And if the market crashes or takes a big dip then temporarily eBay will flood with high end stuff at good prices.
Sucks for anyone who needs to upgrade in the next year or two though !
As someone who advocates that we only use capitalism as a tool in specific areas and try to move past it in other, I’ll defend it here to say that’s not really a market anymore when this happens.
Hyper concentration of wealth is going to lead to the same issues that command economies have where the low level capital allocations(buying shit) isn’t getting feedback from everyone involved and is just going off one asshole’s opinion
I would call that market manipulation(or failure if you wish)--in a just society Sam Alton would be heading to prison.
It’s a classic ‘tulip bubble’.
The actual underlying models of productive output for these AI tools is a tiny fraction (actually) of the mania, and can be trivially produced at massive quantity without the spend that is currently ongoing.
The big bubble is because (like with tulips back then), there was a belief in a degree of scarcity (due to apparent novelty) that didn’t actually exist.
We also were looking for DDR4 memory for some older machines and that has shot up 2x as well.
Hate this AI timeline.
I picked up 32GB (2x16GB) DDR4 (CMK32GX4M2E3200C16) last September for $55. Now it's $155.
Now cheapest single stick is $195
There still isn't a clear path to profitability for any of these AI products and the capital expenditure has been enormous.
Their inventories are not what consumers use.
Consumer DDR5 motherboards normally take UDIMMs. Server DDR5 motherboards normally take RDIMMs. They're mechanically incompatible, and the voltages are different. And the memory for GPUs is normally soldered directly to the board (and of the GDDRn family, instead of the DDRn or LPDDRn families used by most CPUs).
As for GPUs, they're also different. Most consumer GPUs are PCIe x16 cards with DP and HDMI ports; most hyperscaler GPUs are going to have more exotic form factors like OAM, and not have any DP or HDMI ports (since they have no need for graphics output).
So no, unfortunately hyperscalers dumping their inventories would be of little use to consumers. We'll have to wait for the factories to switch their production to consumer-targeted products.
Edit: even their NVMe drives are going to have different form factors like E1.S and different connectors like U.2, making them hard for normal consumers to use.
All you need is a fixed-latency, dumb translator bridge where the adapter forces everything into a simplified JEDEC-compliant mode.
CA/CK Line Translator with a Fixed Retimer as the biggest mismatch between RDIMM/UDIMM is the command/address path.
RDIMMs route CA/CK to RCD to DRAM, and the UDIMMs route CA/CK to DRAM directly, take the UDIMM CA/CK, delay + buffer + level shift it, feed it into a "RCD" like input using a delay locked loops (DLL).
Throw in a SPD translator, PMIC and voltage correction, DQ line conditioning and some other stuff into a 10–12-layer PCB, retimer chips, vrm, and level shifters.
It would cost about $40 million to fab and about $100 per adapter but would make bank with all the spare UDIMMs when the bubble bursts.
I put together a small server with mostly commodity parts.
HBM/GDDR is not necessarily as useful to the average person as DDR4/DDR5
Will just have to settle for insanely cheap second hand DDR5 and NVMe drives I guess.
AI GPUs are stripped away of most things display-related to make room for more compute cores. So in theory, they could "work", but there are bottlenecks making that compute power irrelevant for gaming, even if they had a display output.
But anyway, the trick is to run it in the winter and keep your house warm.
(Not at all)openAI saw they are getting behind their competitors (gpt 5 and 5.1 were progressively worse for my use case - actual problem solving and tweaking existing scripts) are getting better. (Claude and sonnet were miles ahead and I used gpt only due to lower price). Now not only open weights models like Qwen3 and kimik2 exceeded their capability and you can run them at home if you have the hardware or for peanuts on a variety of providers. Cheap-er hardware like strix halo (and Nvidia dgx) made 128gb vram achievable to enthusiast. And Google is eating their punch with Gemini.
All while their CFO starts talking about government bailing them out from spending they cannot possibly fund.
Of course they will attempt to blow up the entire hardware market so if they AI flops they will be able to at least re not you hardware like AWS.
Of course they
But yeah, both AMD and Intel are also pushing NPU builtin into the higher offerings so there is a very good chance that a good portion of AI will be happening closer and closer to users
Kinda curious how the story
not only is it impossible to build that much power generation on those timelines
it's also not possible to build enough GPUs to fill a purported tripling of US datacenter capacity
what's the ROI on giant empty warehouses full of empty server racks and no electricity?
They can afford to pay more.
They’ve all pretty much 5x’ed YTD. That’s completely wild.
Who am I kidding, but the such a high increase means these changes are here to stay, it’s not a progressive change at all.
Especially for systems for which the workloads are actually bound by GPU compute, network, or storage.
2 months ago there were a load of second gen xeon scalable servers on offer. Now every one of them has had the ram stripped out and its just the chassis on offer.
Fabs are not wasting their time on DDR4 now.
> hbm chips are now emerging as another bottleneck in the development of those models. Both sk Hynix and Micron, an American chipmaker, have already pre-sold most of their hbm production for next year. Both are pouring billions of dollars into expanding capacity, but that will take time. Meanwhile Samsung, which manufactures 35% of the world’s hbm chips, has been plagued by production issues and reportedly plans to cut its output of the chips next year by a tenth.
Without that competition, everyday consumers are going to get priced out of the market by major corporations. We have reached a point in CPU technology where newer tech is no longer automatically cheaper and faster to make; therefore, we need more competition to keep prices down.
What do you mean?
We're not, and market dictates that they don't have to talk to know to jack up the prices.
This ram price spike is leading Nvidia reporting for this quarter: gross margins were 70 percent. It's looking like their year over year increase in margins (double) is not because it came anywhere close to shipping double the number of units.
Meanwhile if you look at Micron their gross margin was 41% for fiscal year 2025, and 2024 looks to be 24%.
Micron and its peers, are competing with Nvidia for shareholder dollars (the CEO's real customer). Them jacking up prices is because there is enough of the market, dumb enough, to bear it right this second. And every CEO has to be looking at those numbers and thinking the same things: "Where is my cut of the pie, why aren't we at 60 percent".
We're now at a point where hardware costs are going to inhibit development. Everyone short of the biggest players are now locked out, and thats not sustainable. Of the AI ventures there is only one that seems to have a reasonable product, and possibly reasonable financials. Many of the other players are likely going to be able to weather the write downs.
The music will stop, the question is when.
They put ads in the refrigerators. Never buy Samsung anything ever again.
That includes everyone who works in supply chain at big tech. Permanent total boycott.
I think there must be a tax of all those AI corporations - they cost us as society WAY too much. We need to bring this into the discussion; right now lobbyists such as the orange king want to ban all discussions therein aka making AI investments exempt from numerous things. This is leeching on the general taxpayers, in all countries. It is not acceptable.
There are a lot of elements to this AI shit-show that I don't like or worry about, but taxing them specifically because they're driving up the price of memory when you want some is not really a "societal cost". You then mention something about "general taxpayers" - didn't you just lobby to make them a super tax payer? Go ahead and rant, but seems like pretty basic supply & demand, and keep some perspective; it's computer memory not bread.
That's part of the reason I think this boom-bust cycle might be a bit different. Hopefully, Intel can use some of its capacity that they have coming up in the foundry to service this need.
it literally was intended for exactly that, it has AI in the name of the cpu, and it was from the get go targeted at AI and GPU heavy workloads (3D rendering etc)
Enjoy yohr number goes up fad.
I did have a laptop die because I let it get a little wet.
But when you look at the history of memory, etc, it's certainly going to come back down once the bubble subsides.
But for real, that sucks. The alternatives -- much older, used RAM -- may not be very attractive, depending on what you're doing.
Where I live price for my little cluster project gone up from around ~400 usd in july (for 5 node setup) to almost 2000 usd right now. I just refreshed page and it's up by 20% day-to-day. Welp. I guess they are going to stay with 8gb sticks for a while.
If it doesn't, expect years, till enough new capacity will be build
So if the AI bubble does pop in early 2026, you will get a tsunami of cheap server RAM. You still won't be able to find cheap PC RAM. So either way, the short term future of computing is firmly fixed in the cloud.
You get more margins! You get more margins! Everyone's margins go up!
And that will result in even more resources being allocated into the "big spenders". We are for a long time, in a death spiral for the whole PC field. If it was not crypto mining (multiple times), then it was HDD mining, then it was pandemic, and now its AI.
What used to be a stable market, that was predictable, has become ultra expensive. And now the whole SSD / DDR pricing are going to hurt even more.
Worst of all is, that a lot of resources are now going to enterprise hardware. So even if the AI bubble goes down, its not like the market will be flooded with cheap NVMEs or cheaper DDR sticks, as that production will have gone into 2.5" U.3 drives and LPDDR memory or the likes.
https://openai.com/index/samsung-and-sk-join-stargate
The Samsung announcement contains no reference to scaling up production:
https://news.samsung.com/ca/samsung-and-openai-announce-stra...
Semiconductor companies have been bitten in the past by scaling up production into a bubble, so of course Samsung just raises prices. When you buy DRAM, remember that you are financing oligarchs and that Stargate has lied yet again.