> I think the potential to generate "objectionable content" is the least of the risks that LLMs pose.

> I don't know why it's so important to have puritan output from LLMs …

These are small, toy examples demonstrating a wider, well established problem with all machine learning models.

If you take an ML model and put it in a position to do something safety and security critical — it can be made to do very bad things.

The current use case of LLMs right now is fairly benign, as you point out. I understand the perspective you’re coming from.

But if you change the use case from

    create a shopping list based on this recipe

To

    give me a diagnosis based on this patient’s medical history and these symptoms

then it gets a lot more scary and important.