213 karma · joined January 7, 2025
Yeah this is like if I say something is green how do you know that my green is your green? The proof of the mathematically modeled system is in no shape attached to the symbols that implement it unless its the same program or youre doing trace refinement. And then theres no way of proving that the program is correct in serving the business function unless you run it out. Quite computationally irreducible, the state machine of building state machines
I thought this AI or SI was supposed to make shit easier for everyone.
The future is cooked
Please define proof of "really understands why a medication works"
It reminds me of fynemans why do magnets work. Yeah sure does anyone really understand anything? Its metaphors all the way down
Probably human accountability.
Hypothetically, if a system built by humans then helps humans build the next system that is then initially kicked off with "design something that may influence the lives of other humans" and we all write down that AI is really good so inductively we thought itd be really good at the next thing it builds, and then a critical error is introduced and does "insert tragedy that you personally care about" then your rage would cause you to act politically and want to ask who signed off on it. If the engineering costs outweigh the fine then yeah thats what's probably going to happen but from a human accountability standpoint thats going to suck for the unlucky ones
They also have rational choice to not have to get their hands dirty. What incentive is there?
Ive heard from a 25 yoe consultant in a meetup group in person that aws agentcore was THE best way to handle enterprise agentic workflows with all of the proper knobs for governance etc since it comes with the iam integrations and arns etc.