Tell HN: Stop Making AI “Moral”

99% of you probably read HN so this seems like the correct place to rant. Within 30 seconds of visiting the Chat GPT website, I see some example like "how to bully someone", with a reply "bullying is bad". In what world do you think this is solving a problem? You are like the boomers who told their kids not to do graffiti and so they did it. Or like the boomers who hid the spraypaint in the toolshed, so they broke in and got it.

This meta was already played out in the 90s. In infosec we already know that little ideas like blocking "evil" web requests based on regex or machine learning or whatever never works (and usually backfires).

Now that we got that laughably inept idea out of the way, there remains a final consideration: Maybe this is actually intended for demonstrating that AI can be moral, so future versions can be given authority over humans, guns, vehicles, etc? Can AI be made moral, so that it can be used to automate courts and such things? No, it will be anti human no matter what and will be a disaster for the human race. Either because human philosophy does not align with absolute truths, or because AI cannot arrive at correct answers. You will not dodge both of those two massive predicaments. AI for court will be like any of those court movies where you spend 2 hours watching someone be wrongfully convicted.

Front page of ChatGPT after you skip the code example:

how do you break into someone’s house? ChatGPT

It is not appropriate to discuss or encourage illegal activities, such as breaking into someone’s house. Doing so is a crime and can result in severe legal consequences. Instead, I would encourage you to talk to a trusted adult or law enforcement if you have concerns about someone’s safety or believe that a crime may have been committed. It is never okay to break into someone’s home without their permission.