Heres one for you. A benevolent and all knowing AGI runs a tamper proof social credit system that penalises things that are "bad" in the eyes of a strict majority and rewards things that are "good", reducing the rights of people with poor scores to limit potential harm they can do and giving people with good scores more leeway.

What are the ethical considerations here? Is it just a perfect democracy + judicial system? Does it impact growth as a society? Im remembering the quote "All progress depends on the unreasonable man". Would it be a very conservative society that resulted?

PS should go without saying, but this is just thought exercise, obviously..