Hacker News Reader

99 percent of the time it works every time

1% of the time it launches nukes and tries to destroy humanity

How about just not connecting it to nukes, then?

I'm pretty sure people said this about the early COBOL compilers, too. They were buggy, the API had terrible uptime, and was slow to respond.

Overall, this whole approach to programming seems to align really well with the original premise of COBOL. I wonder when people will start putting

# Identification Division

into their Markdown files.

I'm pretty sure COBOL compiler bugs were deterministic.

When emulated on today's hardware. But the hardware actually available at the time was pretty unreliable by modern standards, I think.

LLMs are technically deterministic too.

Repeat after me: AI is not an abstraction.

you use evals to measure nondeterministic behavior and abstract deterministic behavior behind tools