What tho is the actual cost? Are AI tools still loss leaders? What will happen if the AI bubble bursts and there is a severe shortage of software engineers? It is this uncertainty that people are having to deal with now.
It's easy, it's fast and it gets the point across. Quality is only encouraged socially, people don't really care that much about quality. Rather people have 100 things they care about in their lives - an app for their groceries, a small game of their own idea to show to friends and play, a piece of music about that one time their group of friends got drunk and went into the mountains to fight a bear that in the end turned out to be some old granpa's cow. And only one or two which are important enough to spend the effort to find a quality product.
For software - the places where hard identifiable metric matter... Sensors, weapons, performance, networking, etc. They won't be replaced by AI's any time soon but so many other types of product imo will be assimilated by the machine. All desktop apps for regular people, all websites for blogs, posting, sharing. Probably most IoT related things in your own home
It is hilarious that the machines will first devour the industries that need more feelings and ideas rather then raw precision.
I think they're talking about the marginal cost and capital cost of running all those GPU's, as well as the capital costs of training foundational models. With GPT-(n+m) projected to require new nuclear power plants dedicated to GPU usage, there's a question of what the payback time will be and whether the marginal costs will exceed that of a human.
What LLMs offer is second hand low entropy data. They feed off the low entropy human generated data and give it back. But they raise the entropy of the total body of data, inevitably. The more AI slop there is, the less useful work LLMs can extract from data.
This hammer is however one which becomes stale very quickly unless you keep throwing megawatts and billions of dollars at it constantly. Thus when the bubble bursts it will break all growth predictions instantly and cause a major collapse.
It’s going to be a meaty train wreck and a huge opportunity and I can’t wait. Reckon I’ll retire in 5 years.