First, how do they know it was a resounding success? Just because it didn't respond with "I'm sorry Dave, I can't do that"? Did they actually follow the instructions, created the LSD, and then ingested it to see that it was a success? Did the editor-in-chief know a chemist that makes LSD that would validate the response as accurate? This just begs too many questions.
It's interesting to observe that most people don't understand jailbreaking means removing the restrictions a company put on a product to limit you the consumer.
It seems companies limiting devices is now so normalized that people can't imagine something just being open and not under some companies thumb.
The behaviour was also interesting, it will generate the forbidden text up to a point and then it will error out for inappropriate content. I guess they run some kind of filter that is checking the output and halts generation once foul play is detected.
What a prolific and talented technique. Surely, nobody else could have done this but the hacker (or hackers).