The first point is that LPDDR5 chip's operating frequency today has reached an all-time high of 9600 MT/s, and the latest off-the-shelf laptops (Intel Meteor Lake) are running at 7467 MT/s. This kind of high bandwidth is especially preferred in laptops for improved graphics and gaming performance. The iGPU has to compete with CPU for system DRAM bandwidth (which is already only a fraction of what a dedicated GPU has), every GB/s helps. Meanwhile, SO-DIMM is hitting its physical speed limit due to signal integrity issues (I heard that the impedance mismatch at the connector is too great to go faster). So yes, if you want high operating frequency, soldered RAM is the only option.
The second point is that, it's not always needed for every laptop, of course it's just a matter of tradeoff, many users would prefer lower DRAM bandwidth in exchange for better upgradability. On the other hand, hardware vendors can use this technical limitation as a justification to design machines with non-upgradable memory. You hit two birds with one stone: you can achieve better performance and force customers to pay extra for RAM at the same time.
If CAMM sees mass adoption, it's still up to the vendor to decide if they're willing to actually provide upgradability - but at least it'll be made possible at the technical level.
Of course it’s suspicious that computer manufacturers can make more money in the process. But that doesn’t invalidate the technical argument.
If this standard solves the technical problem, I’m all for it. We’ll have to wait and see which manufacturers adopt it.
The only "AI" feature I use on macOS with any kind of regularity is the built-in OCR to copy text from images. But then my weak-ass Pixel 4a can do the same thing in the app switcher, so I assume it needs neither a fast CPU nor high-bandwidth memory.
The one we're talking about these days which requires high memory bandwidth only existed since 2023. 2022 was GPT 3.5, but locally Llama was the threshold when local llm really took off and that's early 2023. That's in the ballpark of time you normally need to design a new laptop and get it into production.
Honestly I don't think that really factors into it, simply because the vast majority of buyers have no idea what they need to begin with and really don't care about upgradability as a consequence. Why are they supposed to care about whether the RAM can be upgraded when they don't know what the RAM does or how much is a reasonable amount? (and let's not even mention different speeds...)
RAM capacity on the other hand is something everyone needs to care about, because having insufficient RAM brings the entire computer to a screeching halt. Being blunt, I consider it a travesty that computer vendors are selling machines with 8GB of RAM today. 16GB is the new minimum for practical use, with how bloated Windows, Chrome, and honestly everything is getting.
Don't get me started any further on why we even need at least 16 gigabytes of RAM to do the same things we were doing with 16 megabytes back in the day. Bloody insane, this timeline is.
Playing devil's advocate it might be that the more compact you try to make a laptop the less servicable it gets. I don't buy it tho.
When the manufacturers figure out how to introduce upgradable laptops in a way that brings them more money, they will allow and encourage that.
Imagine a laptop subscription, where you pay the full cost of a laptop each year and receive parts to upgrade.