If Microsoft or similar is found responsible for having Sydney generate novel exploits for popular open source software which is then used to hack the Pentagon, for example, it wouldn't end well in court.
This product will need some oversight.
Your example is illustrative. Absolutely don’t want the only LLMs capable of finding exploits in the hands of the NSA/some-TLA. I want it in people’s hands so reports can be made and software fixed.
But if AI models do indeed become as powerful as people say, it’s going to be hard to give cutting edge stuff to a terrorist organisation and rogue states and just be cool with it ?
Kind of like everyone getting access to bombs but worst because they’re more discrete, can be used to deceive, influence people etc.
Not sure how it’s supposed work in practice really. Definitely interested in hearing other peoples takes on this ?
I guess they already have access now. O_o