> The same is true with LLM solutions that don't work 100% of the time.
In my experience, about one of ten LLM suggestions during code review is important and valid. Nine of ten are either unimportant or not valid. Yet, I have to read them and rule them out.Also in my experience, having my colleagues do root cause analysis (RCA) with LLM brings to me invalid RCAs which I have to rule out, instead of working on finding true RCA.
I saw part of documentary about Charlie Abrahams, son of Jim Abrahams. Charlie had epileptic seizures as a child, hundredths a day. In the documentary, Charlie's doctor said that no drug in his experience worked as fast as ketogenic diet (seizures stopped in three days) and as reliably as ketogenic diet (works on more than 80% of people). When he was asked why he did not applied ketogenic diet, he said there still were drug options to try.
"Medicines do not work 100% of time," my bald cranium.