It’s that you can’t pop some system atop a teetering ziggurat of shitty data from mutually incompatible systems and think the fundamental problems are going to just disappear.
Example: I am currently executor of my dad’s estate and trying to get various policies and pensions and whatnot transferred into my mother’s name. One company seemed especially clueless when I emailed them so I called. Part of the voice prompt on the phone system was something like “if the statement we send you comes from city A, press 1, if it comes from city B press 2”. Well that’s a weird red flag right there also a teeny problem: my statement comes from city C. I eventually speak to a human but try as they might they can’t find anything about my dad.
Eventually I write to the company at city C and they’re super helpful. Basically this company is formed from the corpses of various pension funds which just get welded together. There is no underlying integration at all between the systems. They are separate companies in all but name.
You could have an agi chatbot and its still going to be lobotomised by this level of disfunction. In my experience the data landscape at many enterprises is like this.