> This isn't the ME's domain so they aren't aware of the guardrails to enforce.

"User asks for the wrong thing, LLMs corrupts production data" -- fair, do not do this, ME, SE or anyone else.

But I am not talking about safety or enterprise critical systems. In those systems a random SE also does not have the skills to comply with implied guardrails and should not have the authority to do damage. Those systems have explicit, enforced guardrails that apply to every request.

I am talking about prototyping and personal projects. We let softwies use a kitchen knife to cut beans and bread without a licensed ME supervision despite the fact that knives can (and do) cause a lot of damage. In the same vein we should let everyone use LLMs as just another tool and set their own safety vs functionality constraints.

If people feel that LLMs are so dangerous that they require specific licensing like firearms, explosives, etc. they should advocate for such licensing. But it will be a hard sell. My 2c.