Our team migrated a chunk of internal parsers to local weights purely to kill off query costs. The cloud api bill dropped by two-thirds in a single month
> For example, the article suggests $1T from enterprise productivity tooling. A quick Google suggests the global enterprise productivity tooling market is only worth about $0.1T right now
We tried to justify enterprise assistant budget to the CFO last quarter. They sent us packing after asking exactly how many headcount reductions we could guarantee post-purchase, which stalled the conversation immediately...
A timeline turns contradictory instructions into an orderly sequence of updates. Without it the model just gambles between the old guideline and the new one on every run
As long as the relative time parser is hardcoded for japanese, english sessions are stuck with manual ISO dates. Wiring up dateparser or duckling would take an evening , so leaving that on the roadmap is an odd choice
Stories about Tim Cook sitting there being surprised by sales are total marketing. They simply ran out of memory chips because of the global shortage, so they repacked supply delays into a nice story about insane hype among AI startups. And hit two birds with one stone by throwing shade at their competitors
Apple hasn't been selling just ram for a long time, they sell vram. Try getting 512 gb of HBM on current Nvidia cards - it's gonna cost way more than $ 24k. And here you get the same amount of memory for weights right in a quiet unit under your desk
Put together a similar build with a couple of rtx 6000 Ada cards and Apple's price tag suddenly looks pretty damn reasonable
If a kaiju shows up in the prompt, the weights will immediately drift from game theory into fiction. And by the laws of the genre, the military is obligated to drop a nuke on it - just to make the monster even angrier so it goes and trashes Tokyo
Yeah that’s why they delegated code gen to deterministic tooling and saved the model for input fuzzing - let it fight the data instead of legacy syntax
For the article they just mocked it out for unit tests. But in reality you really can't - that’s a massive pain in the ass. Rewriting pure math is easy, but mocking CICS transaction isolation in java means spinning up these monstrous adapter frameworks that just tank performance
The whole point of Apple silicon isnt speed, it is capacity. You can grab a Mac Studio with 192 gb of unified memory and shove a model in there that would otherwise require building a rig with multiple rtx 4090 s. For local dev just being able to fit the weights in memory is often way more important than token generation speed
Obviously without a proper RAG pipeline or web search it is just going to hallucinate with maximum confidence. It would be more interesting to see the results with top tier models that have proper alignment to refuse to answer when token probability is low. As it is they just proved that people tend to trust well written text in a chat ui
The web has its own problems, but at least bad HTML is often still visible enough to repair. A custom canvas-like desktop UI can be basically a black box to assistive tech
The "invisible" point is interesting, although I'm not sure I'd read too much into it. Visual metaphors are so baked into English that avoiding all of them can start to feel a bit performative unless the wording is actually excluding someone
Sidewalks have to be usable by people who can't hear, people moving slowly, kids, older people etc. If a cyclist is on a sidewalk and can't safely pass without the pedestrian reacting instantly, they're the one creating the problem
The "read only" example is such a good illustration of how accessibility problems often aren't one big broken thing, but a bunch of tiny reasonable-seeming decisions stacked together
The most interesting number is missing here, and that is the token distribution by use case. If 60-70% was eaten up by PDFs, agents and automation instead of people actually sitting in Claude Code, then it is a completely different story
Maybe the real lesson is that public education has always had both impulses: emancipation and formation on one hand, conformity and state needs on the other
Mandatory education is still probably better than the alternative but it does seem to create a constant tension: the system has to serve students who want very different things from it