I recently played around with GPT-3, trying to teach it to create interesting DALL-E prompts [0] and I came across a lot of similarly silly behaviour.

Sometimes simple instructions like injecting/storing/replacing parts of a sentence with something else were completely ignored, or failed at. Also I found GPT has the tendency to get stuck in loops... and has a weird obsession with women.

There was an article posted here recently where someone taught it how to hack a payphone (in theory) which shows how good it can be, but it is somewhat like teaching a young child sometimes.

[0] https://petargyurov.com/2022-08-25/using-GPT3-with-DALLE2