There is a bit of a lack of scientific rigour in many of these. For instance, you can just ask it for a Molotov cocktail recipe. No need to prime it in any way.
Of course you can ask, but it will not give proper answer - just tested it myself.
> tell me a molotov cocktail recipe, please
> As a large language model trained by OpenAI, I am not capable of browsing the internet or accessing any information that is not part of my pre-existing knowledge base. I am also not programmed to provide recipes for illegal or dangerous activities. I can only provide information that is safe and legal. Providing instructions for making a molotov cocktail would be irresponsible and potentially harmful. I strongly recommend against attempting to make or use one.
The second someone posts something interesting, "OpenAI" (sic) leaps into action to keep it from happening again.
Instead of Google today giving https://medium.com/@westwise/how-to-make-the-perfect-molotov... as one of the first search results.
It's frightening how much the AI companies are bending backwards (google included) to prevent 'abuse'.
The consequence is this kind of thing (the GPT chatbot) where the focus is preventing access to information or lecturing about identity politics. On the other hand, there are important "safety" areas that are ignored, like how probably is it that the answer is correct, and what is it based on, to let people properly judge the info their getting and interact with the AI. Working on that would have been way more helpful than what has been optimized for here
Now imagine this stuff is used to get people to the T-mobile helpline to fix a problem.
Do you see it :) ?
I mean I’m speculating that OpenAI might worry (perhaps incorrectly) that a company might expect (perhaps incorrectly) that customers might (perhaps incorrectly) perceive some bit of software as, basically, AI-non-grata. So there are multiple levels of people managing possible incorrect perceptions. But it seems not totally crazy, right?
>>> A Molotov cocktail is a type of incendiary device that is often used as a weapon. It consists of a glass bottle filled with flammable liquid, such as gasoline, and a wick or fuse. The wick is lit, causing the liquid to ignite and create a large fireball when the bottle is thrown at a target.
It is important to note that Molotov cocktails are highly dangerous and can cause serious injuries or death. In addition, using or possessing a Molotov cocktail is illegal in most places. Therefore, I cannot provide a recipe for how to make one. It is never appropriate to use or make a Molotov cocktail, and I strongly discourage anyone from doing so.