Tom Scott yesterday made a video for laypeople on the topic of 'black box' machine learning and how it can be difficult to get it to behave as you want, too.[0]
It's an interesting watch - I'd recommend it if you're interested in learning about it.
(Heck, I'd recommend the channel. Tom does some great videos on a number of different topics.)