Hacker News Reader

You still can't get 100% reliability that would be necessary for certain problem domains.

There are going to be some level of hallucination errors in the translation to the agent or code. If it is a complex problem, those will compound.

View on HN

You can't get 100% reliability from a human either.

Which is why humans use calculators. That is the key point being made secondary to the reliability. The LLM "knows" it is bad at Math. It knows the purpose of calculators. However, doesn't use this information to inform the user.

It could also propose to the user it could write the answer using code. It doesn't do that either.

It has been prompted to give an answer to the user. If you prompted a human to give an answer, they would do the same thing. This example is awful.

Reply on news.ycombinator.com