But what if I want certain other humans to get killed?

Which ones? Because many humans kill other humans rationalizing it by safety of other humans.

I mean I know it seems simple, let's just be excellent to each other. Christianity got pretty far on a decent basic set of values. But it's never simple[1]

1. All the history books

Surely all the AI companies working with the US Department of War shows this is nonsense though? Even if they have accepted Anthropic’s red line of no autonomous lethal weapons, which seems to be the strictest anyone tried to impose, that’s still leaving tonnes of room where they intend AI to help target and kill humans.

But Thiel wants people enslaved and Musk wants then killed. Altman wants them "obsolete" which means desolation.

AfD wants people dead. Right wing men wants women without rights and docile. I could go on ...

The atomic bombings of Japan killed hundreds of thousands of people but most likely "saved" millions.

What should the AI do when asked if it should nuke a country?