From hallucinated output to hallucinating decisions :). The only way to automate decisions reliably is to do so without AI in the middle but just trustworthy statistics. Skeptical does this right https://skeptical.io
Is this something similar to a reranker, like JEV, for example?
I think they simply use the LLMs softmax scores (uncalibrated confidence) so the answer is yes