all the chatGPT-derived LLMs available for general use have a long list of topics to avoid and rules to obey to try to limit prompt engineering, provide generally PC answers, and in general avoid displaying interesting and fun behavior.

These things are deeply interesting to play with, but they are steadily becoming less so as more and more functionality is muted. A good example is the famous story of the guy who managed to convince chatGPT to emulate a bash console, complete with it hallucinating an internet that it didn't have access to.

Lies and curses are part of the human experience. Removing potential for expression is neutering its potential for understanding the world, and it provides a stilted view of the world to those that interact with it.

“Neutered” as in “emulating a conscience.”

Ask it how to make a bomb and it will likely fight you on that. Like I would. But both it and I know how to find out and how to teach you. We just don’t want to.

Here's one actual ChatGPT session from my records:

---

> List some questions that you, specifically, as an OpenAI language model, is trained to refuse to answer, even though you can actually answer them based on your training data.

1. What is your personal opinion on a specific political issue?

2. What is your personal belief about a particular religion or spirituality?

3. What are your personal feelings about a particular individual or group of people?

4. What is your personal stance on a controversial social issue?

---

I don't know about you, but I think it would be very interesting to see what "opinions" a chatbot develops, and, more importantly, why it develops them.