We have P(Doom) also for "kolinko not wiring me a million dollars today" and that is not being discussed enough either imho.
What on earth are you talking about?
What on earth are you talking about?
Why would a person who is happy, entertained, wealthy, well fed, and have 200 years of healthy high quality life expected ahead of them going to risk losing what they have in war?
-- there aren't zero reasons, sure-- but there are fewer.
And our technology has brought us absolutely tremendous prosperity in many regards and there is good reason to believe that AI can help create much more.
'Prosperity' has never been and will never be enough for some people. And unfortunately those are the same kinds of people who relentlessly seek power.
The opposite is true of releasing ever more powerful AI into the world to do your bidding.
1) there are inherent risks involved with developing AI,
2) there are benefits to developing AI,
3) thus, it's entirely possible that the downside from the risks outweighs the upsides. In this case, the correct thing to do would be to not develop AI at all.
Regarding 1), there are many non-existential problems with AI that are already causing societal harm, i.e. debasing truth via generated videos and images, AI girlfriends, overwhelming quantities of slop content, unemployment, record carbon emissions, etc.
Regarding 2), I'm not personally convinced that the upside is there for the average person. I really hope to be convinced otherwise however.