916 karma · joined February 28, 2023
Big tech already controls the distribution of traditional platforms so they are building AI platforms to make sure they keep control of the distribution of new forms of content, including that for AI games now that they're easier to make than a YouTube video.
But inevitably these products (and the competitors they will inevitably spawn) put us closer to a future of arguably dystopian, AI-driven hyper-entertainment world, even if no one inside the companies meant to do that. I can only hope in that future many people still appreciate human-made games, and even on these AI platforms genuine human ideas (assisted by AI) can still bubble to the top.
As for game quality, these look close to Opus 5.5 one-shots to me, maybe even a little worse.
(This is temporary until the AI gets better judgement than humans, then capital will therever be the most powerful moat in a market full of dystopic, consequentialist, incredibly long-sightedly-greedy companies)
Being a platform for personal software is gonna be valuable, but it needs a lot of trust. (I have a nonprofit idea around this right now)
Btw, I think distribution might temporarily become less important (because with better AI you can actually pull so far ahead of competitors quality-wise and therefore succeed despite a distribution drawback), but long run it actually becomes more important because of AI persuasion and commodification? If you are the super app then, well, you are the super app
I agree this is a kind of data moat, but it's also arguably distinct enough to be its own thing.
(Edit: alternatively you just use AI to get rid of the need for data to solve a problem, like Jev did for traditional classification models)
I think current incentives definitely go against any efforts to build this. It's very hard to build this and be rewarded for it by, say, investors or your boss, because you can't really prove that your system is non-sloppy while your competitor's is (even if being non-sloppy is all that matters), because by definition your novel results are not verifiable or else the model labs will have already trained it into their model.
But the same is true for high-quality AI systems in general. In general, I think AI model advancements will make the systems easier and easier to build until some small guy accountable to no one but themselvs can build it, and then it will actually be built.
In the longer term, the downstream impact is massive commoditization of software and invalidation of most existing moats. Data moats are gone if you can simulate the data with AI. Even platform effects can be sidestepped if AI replaces one side of the platform.
In addition, while right now agile startups have the advantage, at some point the balance will start tilting towards whoever has the most tokens (OR perhaps durable moats will trump even near-infinite tokens; we will have to see). Startups have a limited time window to have whatever impact in the world they are hoping to have, or to build a moat that won't be disrupted by AI, but there are few of them left in the world.
The upside is that when there is a lot of commoditization, then the consumer benefits.
I think traditional web frontends might be dead for any applications with servers that can afford to keep server-side state of a logged-in user.
(Notably this includes almost any kind of AI application, because the LLM costs dwarf the web hosting costs anyway.)
And for the stateless ones, there's always htmx
Maybe they should recruit experienced meditators who can give accurate introspective self-reports to be compared to the measurements, then we would start to have a relatively confident map between brain physiology and psychology. (e.g. X brain pattern in Y region specifically corresponds to the Z step of reasoning when solving the problem)
It's probably best going forward to grade only in-person proctored exams using paper, or offline air gapped computers in the case of programming courses.
Perhaps they should do something like remove dual-use cyber safeguards on older models as soon as open weight models of a similar capability are released.
I disagree with this part. AI companies will want to try their damndest to control distribution of AI, so that they can enshittify later.
Consumers conscious of this will want an alternative, of course. Might be niche similar to how Kagi is in search because big tech will always have a AI inference cost advantage + making users the product (extra $ from ads & purchase cuts) + the good old strategy of dumping.
But ultimately the AI company CAN choose to just make all the data exportable and open source their product for self-hosting. (The mainstream ones won't, of course, they want to lock you in and hide their AI prompts and algorithms.)
I think what is sorely needed is a version of Dots/Muse without lock-in risk but is still accessible to regular people unlike Openclaw.
And that's why we can't have good things...
(This is just gonna keep happening more and more until eventually we'll need something like a patent system for ideas)
Yeah, I think we need something like that as well. I am actually working on an virtual artifact filesystem in my orchestrator to enable this. So agents can create a persistent, versioned plan artifact separate from the codebase (maybe a HTML) and iterate it alongside the user, much like what ChatGPT/claude.ai can already do but for a coding agent. Then you'd need to define a process and get the agent to follow it, but that's much easier and mostly a mix of prompt and orchestration primitives.
> exploratory implementation elements
This is a good point, I've ran into a lot of instances as well where my agents in plan mode would like to explore something but can't because of permissions. I wonder if there should be some kind of system like a "experiment subagent" to handle it.
I guess it's interesting and useful for now, but I don't think people are going to work at the code level much longer.
In my opinion current coding agents + automatic review systems are already at superhuman reliability during the implementation phase (as in they will not fail something in the plan during implementation and not tell you about it, so there's no need to look at the actual code beyond maybe a cursory glance). I literally just use plan mode + CC's /code-review in each task so it's not like I'm doing anything special. So I think the main human interaction surfaces to target in the future will be in the planning process.
From the website demos i definitely think this is a clean interface, although I don't know how much better this is compared to some simple custom Mermaid format, which the agent can write as artifact files and present to users. Zooming out, this app seems like 1 feature (a MCP with a GUI attached to it) rather than an entire product.
Also, I don't know if asking the agent to write specific code changes into the plan is a good idea. I think maybe that a "plan -> approve -> write code" would let the agent write higher quality code than "plan which contains code -> approve". But maybe you can make it work when combined with some specific prompting marking the code as clearly work-in-progress and subject to change, and that the agent should surface any parts implemented differently relative to the plan to the user, etc.
For an idea of what a serious AI forecaster expects a coordinated AI slowdown to be feel like for the average citizen, see:
https://ai-2040.com/?choices=plan-a-root#playbook-public-pov
I don't know how the antagonistic pleiotropy theory is doing. If true it would be a satisfactory explanation from an evolutionary point of view but I recall that it had some problems.
Otherwise I don't find the other evolutionary explanations of programmed aging to be satisfactory, especially when you consider that genes are selfish and act on the individual rather than population level.
Perhaps reproductive aging (egg quality) is the ultimate limiter, and then overall aging is adaptive downstream of that because hunter-gatherer families benefit (in terms of evolutionary fitness) from fewer old people to increase the percentage of people at reproductive age? That would fit the modern evidence of early egg freezing significantly increasing reproductive success in older women, showing that the problem of fertility decline by age is primarily cellular.
Or perhaps the aging mechanism is leftover from pre-human ancestry and there simply wasn't enough time in our evolutionary history for humans to evolve longer lifespans, maybe because it's slightly helpful but not nearly as helpful as other traits like intelligence, and lifespan is hard to improve via genetic adaptation due to bottleneck effects?