That same story happens without LLM involvement. I’ve also seen LLM suggest updating a lib. So unfortunately nothing about this story speaks to a difference between LLM and human capabilities.