"Appears" to me is the key word here, how do you know that what it said was true?
It will very confidently "answer" your question in a way that is convincing but if you actually try to click through you may find that the answer is straight up wrong.
I feel like most of the time that I am looking up something that is not niche but also not a major thing it does this and at best useless at worst actually harmful since people won't click through for the real information.
The biggest problem being that these systems can be right enough times that you gradually start trusting it and stop checking. Which is what google wants, if you have to check its work in the first place why does it even exist.
Edit:
Yesterday I tried using one of these research tools because I was curious and it was low priority so figured why not. I was looking for an open source solution to a problem. I specifically mentioned one that I had seen but I was cautious because it seemed to have been abandoned so was looking for others. It confidently told me how wrong I was about thinking it was abandoned despite the last commit being in early 2024 (it even said 2024 in the report) and even before that was clearly slowing down.
Now thankfully in that case it actually told me in the report the 2024 part which clearly told me how bad the report was going to be, but that is clearly bad and tainted the entire research.