14 karma · joined January 23, 2020
where do you pull the exercises from?
You don't do this for any other kind of decision or tool, why do you need it for LLMs?
i think in truth you need a source that convinces you (or the regulator) that your choice is acceptable, so that you can pass off the responsibility. If the LLM were to give you an answer backed by relevant (cited) source documents of regulations and a good explanation it would make no difference compared to a human worker doing the same. -> this is already possible
Forcing goals onto a disgruntled/unmotivated engineer will end badly. Giving no goals to motivated engineers will also end badly. Giving bad, unrelated or unachievable goals to motivated engineers will end in disgruntled or unmotivated engineers.
You have to get both right.
isn't this exactly the (theoretical) strength of a chatbot - asking follow-up questions to remove uncertainty?
The only thing i haven't fixed yet is hiding the cookie banner for bots :/