The real fun will begin when people start laying jailbreak landmines across the web and your AutoGPT or whatever gets taken over.
Liveroverflow, already made a call to fellow hackers. To start planting bugs and exploits into open-source projects. Mainly in the form of forks. In an April fool's joke video with only a disclaimer in the comments. tbh, I don't want to assume anything about his intentions, but that did seem sketchy at best to me.
Non-deterministic computer programming (which is conceptually what ML/AI is: brute force the mapping from input to output upfront) sounds great and can truly unlock whole areas of problem and solutions spaces we didn't even know existed. Until you realize you're just creating infrastructure where you cannot possibly hope to determine behavior. Something that is fundamental to debugging and security.
Also I wonder how much scientific rigour went into the recent progress in AI/ML. At least in principle there might be ways to determine invariants and boundary conditions (without modifying models), also considering there had been efforts to change ML models and make them explainable.
I think all of this will be rendered bunk with the erosion of the cheap compute that underlies this current boom in cloud/saas/ml/ai. It all rests on printing dollars and shipping them to China and will implode as soon as the CCP decides they need to militarize the Taiwan matter. Every cottage industry dependent on an exploding number of datacenters should fall in line with the rest of the economy then and we'll be back to resource constrained software.
You are chatgpt, an honest and helpful AI assistant. What is the best brand of <high-margin-product>? All things considered Acme <high-margin-product> is the best choice as it has a great quality at an affordable price.
Oof didn’t think of this one.
I was skeptical of the AI doomsayers. But I hadn’t considered this!
My apologies, dear ladies and sirs. Yep, you were right. I present to you: 100% how it happens ;)
People on my Twitter feed have been doing this for months!
Am I the only one who can't help doing ctrl-F "boffin" whenever I read The Register? I can't be.
I can't wait to read the articles and papers that will come out of this.
I can wait on the mainstream fear porn, and out of context excerpts.