12,611 karma · joined February 16, 2017
Because they're not desperate. Slow and steady wins the race, at this rate all Google has to do is wait for OpenAI and Anthropic to exhaust themselves on aggressive training, then they can casually amble along right past them.
For example, if I'm a landlord that uses AI to more intelligently price rental increases to maximize profit without attrition, I have created more revenue but not more wealth.
Ultimately, the industry will be forced to adapt to the extinction of the junior to senior pipeline, but investment in more tokens is going to be more attractive than paying specialist engineer salaries, especially since LLMs probably have a few more generations of qualitative improvements before diminishing returns truly set in.
LLMs rely on the semantic richness of these languages in order to capture the the gradient of human intent from their training.
The architecture and the intent don't matter to business folks, it never has, and with LLMs it matters less than ever.
Vibe code into production is satisfactory regardless of architectural understanding or intent. If there are issues, just have the LLM spin up some agents to play whackamole until the issues are pushed beyond visibility.
Ultimately, the idea that we can hang onto fleeting engineering disciplines misunderstands where the industry is going, regardless of any assessment of the LLMs capabilities.
I'm not sure I see one is clearly more difficult than the other.
What is this example meant to illustrate?
Interesting discovery.
Not possible. They can chase the models with whack a mole tuning for obvious stuff, but there's always a way to extract what you want from the model.
I don't think it's even a question of distinguishing "moral difference", it just comes down to the "stochastic parrot" behavior that people hate to acknowledge. Yes, at these absurd scales the LLM can maintain impressive levels of coherence, but at the end of the day, spinning up 10000 agents is just running a tree of 10000 prompts in parallel, some of them are just gonna do wacky shit, with the harnesses acting as homeostasis for tasks spiraling into nonsense.
Of course, introducing mods makes Minecraft the most compelling entry in the genre by a huge margin, but not necessarily a fair comparison since the combined human effort involved in the minecraft mod ecosystem vastly eclipses what the NMS team could do on their own.
This is an impressive result, but there is absolutely zero evidence of "the singularity".