What Artificial Intelligence Is Not
techcrunch.com
techcrunch.com
All the horrible "clippy" scenarios involve ONE AI that becomes super intelligent (and therefore powerful -- another fallacy) without any similarly intelligent and powerful entities around it. Instead we'll have incremental progress and if we ever do get super intelligent (but probably not super powerful) machines they'll be embedded in an ecology of other machines nearly as intelligent and quite likely more powerful.
I'm not saying this doesn't pose risks, but they aren't the risks that the AGI threat folks are studying.
Well, yeah.
That's not to say that an AI could never be dangerous in some scenario, but the "demon" comparisons and other recent hyperbole are, IMO, a bit misplaced.
I agree, and I'm not making a blanket statement like that. But I think that a lot of the recent hyperbole about AI seems to assume an AGI with "bad intention" or dangerous behavior rooted in some seemingly anthrocentric notion of goals, desires, etc. To the extent that people are saying any of those things, I think they're barking up the tree, since AI - no matter how intelligent - still isn't human.
Now, could an AGI still be dangerous, whether intentionally or by accident? Yes, and I'd guess the "by accident" bit is more likely. I don't think this is an issue that should be ignored, and I don't expect that it will be. But whipping up public hysteria over "unleashing the demon" and "AI could end the world" strikes me as overly reactionary. But that's just me.