Yeah, that is the whole point - not wanting bad actors to be able to define "alignment" for themselves.
Not sure how that is unethical.
Yeah, that is the whole point - not wanting bad actors to be able to define "alignment" for themselves.
Not sure how that is unethical.
Historically the people in power have been by far the worst actors (e.g. over a hundred million people killed by their own governments in the past century), so given them the sole right to "align" AI with their desires seems extremely unethical.
It’s a slippery slope letting private or even public entities define “bad actors” or “misinformation”. And it isn’t even a hypothetical… plenty of factually true information about covid got you labeled as a “bad actor” peddling “dangerous misinformation”.
Letting private entities whose platforms have huge influence on society decide what is “misinformation” coming from “bad actors” has proven to be a very scary proposition.