Constitutional AI: RLHF on Steroids

From the site:

"I know that evolution optimized my genes for having lots of offspring and not for playing video games, but I would still rather play video games than go to the sperm bank and start donating."

Talking about creepy. It is a terrible idea to talk about ethics and, who knows, morality, with ideas framed aong concepts like men sperm and video-games.

Really neat! A clever idea, and it's good to see this kind of work being done.

Also, does the second image in the article change when you click to open it, for anyone else? The normal preview in the page shows as a duplicate of the first, maybe a Substack bug or something.

Good insight that training something on what it already knows it's not an (impossible) perpetual motion machine. Knowledge is not the same as motivation, and training on knowledge changes "motivation".