phone storage hasn't mattered to me in years, what do you guys need the huge storage these days? the bulk of my data in the past was photos and videos, but now those are uploaded to the cloud and i instantly delete from my local phone.
Removable storage should come standard with any device.
With that said, your instance is just your instance, and for swathes of people it will be cheaper to have local storage. Them having the option of local storage wouldn't hurt you, so I would hope for their sake you would still support giving them that choice.
If you're shooting prores video... you have a portable usb-c jbod array, so I guess it doesn't matter indeed.
> there's not enough performance for large models to be useful
For iPhone, the Private LLM app offers 44 models in its easy-install menu right now (on 15 promax), with avg model size about 2.7 GB.
Total GB is ~120 GB to install and compare them all.
People could argue about what being useful means, but asking these different models the same question can give quite different (and indeed thought-provokingly different) results.
They all have either different foundations or different fine tuning or something. The same prompt gives rather different answers depending on what model you pick. It's fun that way.
So to compare their outputs, one would need 120GB free at once, then install them all, or else do some very inefficient and weird dance of uninstall-then-reinstall n times while picking and choosing which ones to try out for a given prompt.
And that's just for one offline "gen AI" app. There might be others.
This can be done offline, while on a walk, or whatever, without hitting any servers at all, in the palm of one's hand. Performance is good enough on iPhone for a bunch of tasks/prompts.
So, IDK. Does part of that not make sense? These models not being run run at once, and don't need to be in RAM at once. They're being stored on disk at once to be used when wanted. They initialize one at a time when in use. The large disk size is for storing the models. The phone can then use the models when wanted.
(Granted, it's not the "same" as hitting huge versions of the models sitting on some beefy infra, but we're talking about mobile devices here and actual current uses for having a bunch of local storage available on them.)
Recall where the thread started: https://news.ycombinator.com/item?id=41631782 A question about what use cases people have for large amounts of storage on phones, aside from photos and videos that are easily offloaded to the cloud. When someone replies that they need tons of storage for LLMs, it's quite reasonable to want to understand where that need comes from, how much storage is actually needed for that use case, and whether it's anything that could become popular enough to influence product design decisions or if it's something that will only ever be done by HN nerds. If the best use cases HN can come up with for more storage on phones are things that are unlikely to go mainstream, then we should be assuming that phone manufacturers aren't going to be feeling much pressure to change their storage strategies.
Complaints about product design choices rarely produce interesting discussion when they can be reduced down to the complainer not making the distinction between their personal usage patterns and those of the target market in general. LLMs are still a very new class of workloads for phones, and what an early-adopter HN user is doing with LLMs on a phone could be a preview of an emerging trend that may go mainstream—very on-topic for HN discussion. But in this case it looks more like a use case that will forever remain an outlier.
(It's totally okay to be an outlier and do things with your gadgets that hardly anyone else would choose to do or even think of doing.)
You are right however that "manufacturers [specifically Apple] aren't going to be feeling much pressure" to change their design because right now they are absolutely gouging the general public and making hundreds of millions of dollars off of it. An iPhone 16 Pro 128 GB is $1000, and a TB is $1500. They are selling less than a terabyte of space for five hundred dollars, over five times the cost of a gold standard 1 TB micro SD which costs under $100. If you opt for iCloud you pay almost a thousand dollars a year, well over 10x as much as a micro SD. Of course there is no pressure to divert from their current model: They're getting away with highway robbery. Scale that to the 150 million or so people with a valid need for storage (again, this is an extremely conservative estimate) and you have numbers in the billions. They will ABSOLUTELY ignore a valid need and never fix the problem of not offering a reasonable storage method if their insane storage method results in so much money.
Do you mean 10% of iPhone users want to keep a few dozen LLMs on their phone (obvious bullshit), or that in aggregate at least 10% of iPhone users would buy more storage if it was cheaper (to say nothing of the customers who always buy the most expensive config as conspicuous consumption)?
Can you do this without apple managing your data?
(it would be really nice to have a personal icloud replacement)
but think about it, how crazy that someone can steal your phone and you would be totally fucked, priceless memories lost forever. now with cloud that's a non-issue no?