Similar to my thoughts. If we are still scrambling to find stuff the average Joe finds useful, the 100s of Billions poured into this gold rush are wasted (IMHO).
It's not even a solution in search of a problem, it's a tool in search of a reason to use it as a solution to a problem on such a scale that it justifies the billions of dollars of money we've poured into it while driving up the cost of fresh water, electricity, RAM, storage, data centre space, and so on.
Consumer adoption also happened organically over time, catalyzed mostly by email and instant messaging, which were huge technological leaps over fax and snail mail. IBM and DEC didn't have to jam "Internet" buttons all over their operating systems to juice usage (although AOL certainly contributed to filling landfills with their free trial disks).
Feels like this combination (usually) creates a race to the bottom instead of expansion of new ideas.
LLMs kind of feel somewhere in the middle
This isn't one of those times.
I’m spending $400/mo on AI subscriptions at this point. Probably the best money I spend.
but lots of folks were broke as hell and miserable
I'd say for an estate that I am the executor of, it probably saved me $50k in legal fees and other expenses because it helped me analyze a novel problem and organize it ask the right questions of counsel.
Another scenario i had to deal with i needed a mobile app to do something very specific for a few weeks. I specced out a very narrowly useful iphone application, built it out on the train from DC to NYC, and had it working to my satisfaction the next day. Is it production code ready for primetime? Absolutely not. But I got capability to do what I needed super quickly that my skill level is no longer up to the task to accomplish!
IMO, these things let you make power tools, but your ability to get value is capped by your ability to ask the right questions. In the enterprise, they are going to kill lots of stupid legacy software that doesn't add alot of value, but adds alot of cost.
The technology is amazingly powerful. Full stop.
The constraint that drives cost is technical — semiconductor prices. Semiconductors are manufactured commodities over time, those costs will drop over time. The Sun workstation I bought for $40k in 1999 would get smoked by a raspberry pi for $40.
Even if everyone put their pencils down and stopped working on this stuff, you’d get a lot of value from the open source(-ish) models available today.
Worst case scenario, LLMs are like Excel. Little computer programs will be available to anyone to do what they need done. Excel alone changed the world in many ways.
that $400 will go up by at least a factor of 10 once the bubble pops
would you be prepared to pay $4000/month?
I doubt that the exponential cost explosion day is coming. When the bubble pops, the bankruptcies of many of the players will push the costs down. US policy has provided a powerful incentive for Chinese players to do what Google has done and have a lower cost delivery model anyway.
> the bankruptcies of many of the players will push the costs down
the running costs don't disappear because people go broke
The cost iceberg with this stuff isn’t electricity, it’s the capital.
Other than Google and Facebook, the big hype players can’t produce the growth required to support the valuations. That’s why the OpenAI people started fishing for .gov backstops.
The play is get the government to pay and switch out whatever Nvidia stuff they have now with something more efficient in a few years.