While it's great to clarify, LLMs are actually finding bugs and writing exploits [1][2]. There are more example though.
https://blog.mozilla.org/en/firefox/hardening-firefox-anthro...
I think the Mozilla example is a good one because its a large codebase, lots of people keep asking "how does it do with a large codebase" well there you go.