What's the danger? It can see the schemas to help it generate the queries but it can't run anything on its own. Also you have to give the application credentials to an AI provider for the feature to work. So, you can just not do that.
Hallucinated ideas about what needs doing, what commands to run, etc.
So, data that's no longer reliable (ie could be subtly changed), or even outright data loss.
https://en.wikipedia.org/wiki/Automation_bias
And hopefully the users who are using this aren't YOLO-ing it. Though I'm pretty sure we're all expecting there will be a sizeable percentage who are.