Apple Fails to Clear a Low Bar on AI
wsj.com
wsj.com
I was running Stable Diffusion on my iPhone two years ago. You can get quite good open weights models running on-device today. What’s going on over there?
Counterexamples: https://machinelearning.apple.com/research/
Also they still have a streak of secrecy so I wonder if any researchers are skittish thinking that Apple might just arbitrarily stop them from publishing certain papers?
xAI doesn't innovate, doesn't publish papers, and started literally a decade later than Apple into AI, and yet they're ahead of Apple in AI.
So the high order bit is something else. Apple seems consumed by its legacy dependencies, structures... people even. There's no one on top with focus. I'm not even saying "with vision" or "with competence" or "with expertise". I'm just saying "with focus". If Tim Cook wanted an LLM he'd have a top of the line LLM running in 6 months with the resources he has. He doesn't.
His focus is on making lots of the things he wants to sell, and he doesn't care, or understand what those things are. This is why they have warehouses full of unsold Vision Pro inventory now. He's a logistics guy. Blind to the rest.
And Apple was doing great with someone like him at the top for years. But now the backlog of products is over and they keep shipping duds, while their software work is nosediving.
They need someone who understands "product" stat. Someone with holistic instincts. Someone like Jobs. I mean at least a bit like him.
I suspect Steve Jobs would be very aggressively driving them internally but also not necessarily releasing much yet either.
and, I’m not a major user. I don’t TikTok, X, Instagram, or any other social media. Nor do I do much else on my phone that I see heavy users do around me
Especially now that their App Store revenue is collapsing
It wouldn't take much for a "Apple have taken a wrong turn, and have left themselves unable to participate in the race for AI" narrative to take hold. If that happened, it would severely damage their position at the premium end of the market.
https://ioshacker.com/iphone/how-much-ram-does-my-iphone-has
Take MS, sure they are doing a lot with AI, however some matters like Recall I'm not sure they can ever fully step back from, the trust has been lost for many by a rushed attempt.
I know there's a difference in the OS having access to everything on your screen, but people will still calm down once there are useful benefits delivered.
I know several people who were actually excited for Recall, rather than horrified by it.
It's a reminder that generally, what techies on HN (and especially Reddit) think is generally the opposite of the general population.
Yesterday's presentation shows that their software wheelhouse is making fancy user interfaces.
Gemini hasn't even been "the best" for a year. Google's quick answers AI is the most laughably bad high-exposure model out there. In six months, Anthropic or OpenAI or any other provider might have a model or models that are exceedingly good for the use cases that Apple cares about.
Hell, Meta or Microsoft might surprise us and make a really robust model that uses very little in the way of resources and battery (arguably, MS has in the past and will do it again), and on-device compute will be the best option.
There's no best option right now. And if you're not aiming for short term ROI on AI products, there's no reason to make commitments that you might regret in a quarter or two.
It’s been done and every tech company wants to find the next game changing thing.
I’m kinda rooting for Apple on this one. Give me a smarter smart phone that doesn’t sell out my privacy.
If they can do that and whatever AR or VR or whatever ends up finally being usable perhaps it will be built with user privacy back in mind. As it is I’m not getting anywhere near a Meta or a Google or an Amazon reality device
I think the real pressing issue is not ‘privacy’ or ‘tracking’ or whatever; it’s having one’s views slowly but surely warped by AI-enabled mass disinformation campaigns and having one’s eyeballs taken hostage by whichever company pays enough to keep you watching. Half the world seems to now be addicted to short-form video slop/brainrot now, and they don’t even enjoy it!
That’s really the hallmark of addiction — you’re consciously aware that it’s completely pointless and detrimental to your life and yet you can’t put it down.
Perhaps the same was said of TV when it was new, but, looking at what the BBC used to broadcast as recently as twenty years ago, I’m shocked how far we’ve fallen. If Apple really wants to save the world, they should find a solution to this. Since (fairly uniquely) their business isn’t dependent on selling attention to advertisers, they might just have a shot.
Apple made their money when they sold an expensive bit of hardware. They even use some of these large margins to build out private compute cloud to make sure they never see what you send them
Frankly they are the only big tech company I will even remotely trust. The fact that their AI isn’t bleeding edge is a feature for me
If everyone's iPhones already do everything they want, the only reason to buy a new one is if the current one breaks. Which would decimate Apple's stock price.
Just got rid of a 9 year old 6s a few months ago that still worked fine!
Not sure you can fault Apple for stopping investment in software for devices past a certain age. And certain functionality just isn't supported by older hardware.
Doesn't mean the devices stop working. Just that Apple is saying you're on your own.
(Although the proprietary nature of Apple software means you also can't continue upgrading the software on your own or through a third party.)
Sure it'd be nice to continue to be able to upgrade the software on out of support devices, but how long can we really expect a for profit company to support old stuff? I personally think 5 years is fine for a phone.
Time will tell what they do about apple silicon Macs though. The M1 is 5 years old now, and is still capable for pretty much all workloads if you have one with enough RAM. I could see it being still useful for 5+ more years. It's there I would expect at least 10 years of support, I think.
I care that they do the tasks I command them to do, quickly and efficiently. If the developer achieves this using AI somehow, great. If the developer achieves this using traditional algorithms, also great. It doesn't even remotely matter to me if they are "using AI" any more than it matters whether they are "using Python."
i don't need that sort of thing
If the tech ever reaches the point where Apple can fully do, on device-first and there's no issues with it, then they'll likely invest drastically into it.
And no network latency.
This stance will probably age very poorly but that's what it is.
If that's their stance, they aren't wrong.
This is like saying "Company X is behind on Python" when they just don't use Python to make their products.
No one has reached the bar.
AI products have shown a lot of progress over the past few years, even if they haven't "reached the bar".
But Apple is failing to deliver anything solid in the same time frame. Disregarding an arbitrary notion of "reaching the bar", they need to show progress.
There's basically one "killer ai app", that's the chatbot. There's a second, plausible case, for agentic additions to IDEs.
But where is this high bar we're meant to be seeing? All I see is google and stackoverflow being replaced by openai.
Inverting it, what are the AI features that Google has shipped that are getting people to upgrade their Android phones, or to switch to Android?
My Apple devices are pretty useful for AI devices now given that I can run e.g. ChatGPT and Claude on them. I know they have to do something so the tech press can stop saying they are behind, but it still feels premature given lack of consensus on how best to integrate phones with the unreliable AIs we have today.
To whom?
We have shitty chatbots which confidently spew garbage and a new button on laptops no one wanted.
And the customers are worried that the technology is coming for their jobs, their income and their lives.
But I don't think they are consciously doing that. I assume like every other company they are throwing a lot of resources at the new hype and just failing, and this is the backup plan. I'm not sure what that says about the strategy at the top.
The tendency for LLMs to flub and hallucinate gets downplayed but I think it’s actually the main blocker for it becoming a “smartphone killer” kind of thing. The problem is that fixing this issue is anything but easy and might even require actual reasoning capabilities (not the current Markov chain ping-pong “reasoning”), e.g. something adjacent to AGI, and I think we’re probably still many years away from that.
This will play out exactly how you think. The hubris will be confronted with harsh reality at some point, all of the chest puffers will get real quiet, and companies like Apple will look wise for not getting too involved, too soon.
If the mac worked the way the iPhone does the mac just wouldn't have a browser until after the .com boom was over. That's why I'm shorting them. Their inability to give people an escape hatch so their users can actually do useful things with what they build is killing their platforms.
iOS devices are just consumer devices for consuming content. They're almost a completely different platform.
As for integrated AI, I kinda like that Apple is trying to get it "right" in the sense of being on device in many cases (or at least capable of it) and secure (privacy respecting).
Their models are behind though. If they were really serious they would buy Anthropic or Mistral with all their cash. Anthropic might not sell but Mistral seems like something they could bulldoze with cash if they wanted, and they'd get better models and a better model-making team.
In my 12 years of employment in this industry, I have yet to encounter a MacOS build server. "Serious work" doesn't happen on MacOS by design; it's not a deployment platform. You don't put Mac instances on your K8s network, most of the time your customers aren't using a Mac either. Even big companies like 1Pass have realized what a waste this is, and started porting their Mac software to Electron. Apple couldn't dominate developers if they systematically murdered every other POSIX-compliant OS.
The more time you spend as a development studio optimizing for a runtime you never use, the more capital you waste to achieve the same end-goal. It's not a real thing outside the comically capital-intensive SV culture.
I'd argue GNU-style CLI and libinput based tools are actually more discoverable than GUIs now that smartphones killed CUA and friends. Is pressing tab twice really worse than "reverse three finger pinch?"
The Foundation models/SDK/APIs are a big step in the right direction but they are coming 6-12 months behind everyone else. AI is an area that it's not at all clear if "slow and steady wins the race" (Apple's normal MO). If there is a paradigm shift in how we interact with our phones using LLMs then Apple is going to get left behind as thing currently stand.
It's also damning that Sky [0] didn't come out of Apple. More damning is that the majority of the team behind Sky _DID_ come from Apple (and Workflow, aka Shortcuts) before that. Why did this team feel they had to leave Apple to create something like Sky? Maybe it's a ploy to get acquired again but I think that Apple just isn't good at LLM-based products because of the uncertainty. Apple wants to avoid the "glue on pizza" or "stop taking your meds" moment but it's causing them to miss the boat completely.
LLMs are far from perfect, they lie/hallucinate or just lose the plot. That said, there are some really valuable things you can do with them. Historically Apple has been unwilling to accept the downsides and would rather wait to ship but with LLMs I don't think they are going to ever get a "no downsides" approach to work.
I think the clock on this won't start until someone ships something compelling that is not available on Apple devices. Currently, the leading AI tools have first-party iOS apps.
> Why did this team feel they had to leave Apple to create something like Sky?
No personal knowledge of that team, but the economics around an acquisition of an AI-based product in this market are very different from the economics around "generous bonus for shipping a successful product."
Time for an acqui-hire?