2,095 karma · joined March 24, 2017
Conversely, when you deposit cash to a bank, you are actually creating a liability on the bank's balance sheet - as you might want your money back one day!
This artical makes the case for C as a low level language, I then offer Javascript as a functional-ish language for manipulating domain model data structures on the top.
Per the Cambridge Dictionary: "an occasion when an army or country uses force to enter and take control of another country"
In our case no 'taking control' has occurred, so this is not an invasion.
It is unclear what will happen next, but likely the regime or large elements of it will survive. Perhaps a more moderate faction will take control? That would be the best case scenario.
Maybe the Venezuelan government remains intact, and now we have the embarrassing situation of a sovereign country asking for its head of state back.
I think this gets to the crux of the issue with LLMs for coding (and indeed 'test orientated development'). For anything beyond a most basic level of complexity (i.e. anything actually useful), code cannot be verified by compiling and running it. It can only be verified - to a point - by skilled human inspection/comprehension. That is the essence of code really, a definition of action, given by humans, to a machine for running with /a prior/ unenumerated inputs. Otherwise it is just a fancy lookup table. By definition then not all inputs and expected outputs can be tabulated, tested for, or rewarded for.
When the ROI in training the next model is realised to be zero or even negative, then yes the money will run out. Existing models will soldier on for a while as (bankrupt) operators attempt to squeeze out the last few cents/pennies, but they will become more and more out of date, and so the 'age of LLMs' will draw to a close.
I confess my skeptic-addled brain initially (in hope?) misread the title of the post as 'Reflections on the end of LLMs in 2025'. Maybe we'll get that for 2026!
Then along came 'right-to-buy', allowing tenants to buy their social housing for knock down prices (and so become a natural Tory [right of centre party] voter).
If councils had been allowed to use the money to build more social housing, then maybe this was fine. But they were not. So now we have affordability issues in the UK too.
This allows decentralised decision making for large grained resource allocation - for example should we build a factory for shoes, or for toothbrushes? - and is a good thing, as central planning has been demonstrated to not work if applied to the whole economy. (the converse, no central planning to any of the economy, has also been demonstrated to not work!)
However that accumulation can be (and nowadays usually is) orchestrated by a corporate entity, which in an ideal world would be almost entirely beneficially owned by retirees on an equitable basis.
What has gone wrong, is that the benefits of productivity enhancements (since 1970?) have flowed to capital more so than to workers - which not least prevents them from forming capital themselves (savings/pensions), hence rising wealth inequality.
Key point. Once people realize that no money can be made from LLMs, they will stop training new ones. Eventually the old ones will become hopelessly out-of-date, and LLMs will fade into history.
This means that society as a whole is perhaps significantly poorer than if LLMs had been properly valued (i.e. not a bubble), or had simply never happened at all.
Unfortunately it will likely be the poorest and most vulnerable in our societies that will bear the brunt. 'Twas ever thus.
A logician / formalist would argue that mathematics is principally (entirely?) about proving derivations from axioms - theorems. A game of logic with finite strings of symbols drawn from a finite alphabet.
An intuitionist might argue that there is something more behind this, and we are describing some deeper truth with this symbolic logic.
When a bank issues debt, the money is created 'out of thin air'. When the debt is paid off, that money is destroyed. However usually more debt is being created than redeemed as things go on, so the total money supply increases (this is a good thing, as it allows the economy to expand).
Various regulations and central bank market interventions (quantitative tightening/easing) control this process, which thus can be induced to 'print money' if the government wishes - assuming they have a sovereign currency.
[1] https://en.wikipedia.org/wiki/AI_winter#The_setbacks_of_1974
[2] https://en.wikipedia.org/wiki/AI_winter#AI_winter_of_the_199...
The cleanup is going to be a grim task.
2. Ban tainted code.
Consider code that (in the old days) had been copy pasted from elsewhere. Is that any better than LLM generated code? Why yes - to make it work a human had to comb through it, tweaking as necessary, and if they did not then stylistic cues make the copy pasta quite evident. LLMs effectively originate and disguise copy pasta (including mimicking house styles), making it harder/impossible to validate the code without stepping through every single statement. The process can no longer be validated, so the output has to be. Which does not scale.
The first freedom of course is freedom from fear (e.g. from fear of being snatched from the street just because you are brown and speak with an accent)