Anecdote: Gemini 3.5 casually added a DROP TABLE for an actual production table in a system test.
It had previously attempted to create that table as part of the test setup, so it apparently concluded that it was a test table.
During human review, it explained that it had simply chosen a table name inspired by the codebase.