ChatGPT often makes up facts. It outputs stuff that looks like it could have been written by a human, not stuff that is correct.
Don’t use ChatGPT for medical research.
Don’t use ChatGPT for medical research.
Google gives you sources, determining reputability is your task.
And we also do not do medical stuff. I just used that as an example.
Or Google. There are plenty of pages out there that (e.g.) claim that Alzheimers is caused by drinking out of aluminum cans, or that the world is controlled by grey aliens from Zeta Reticuli.
As opposed to... Google? Your doctor? My doctor?
https://doi.org/10.1371/journal.pmed.1004085
You can't take such articles seriously unless they have been independently reproduced multiple times. So, your hypothetical "ChatMD-GPT" would have to also filter on that basis and perhaps calculate some sort of confidence level.
Information generated by humans will include things like transpositional errors, logical errors, popular misconceptions, and misinterpretations of data. Mistakes happen, but human mistakes are at least tethered to real thoughts/information.
On the other hand, AI will happily spin up a complete fabrication with zero basis in reality, give you as much detail as you ask for, and dress it all up in competent and authoritative-sounding prose. It will have all the style of a textbook answer, while the substance will be pure nonsense.
Still a great tool, but only with the caveat that you approach it with the mindset that it's actively set out to catch you off guard and deceive you.
Sure. What makes you think a human won't?
Just like it is harder to find primes numbers than verify that a number is prime, it is harder to dig up potential tidbits of information than to verify a piece of information handed to you is true.