Exactly this. ChatGPT cannot answer 90% of the questions I ask it. The reason? Because the information I’m looking for exists after 2021. I have no idea how this would ever replace a search engine that has real-time results.
I know your point is about product features not accuracy, but these things may be connected. It might take an AI to sift through the shit we created via SEO.
That said, I tried using ChatGPT today as a stack exchange replacement and it was like a smart 7-year old. Sounded super impressive but wasn't actually correct.
We are very closd to superhuman levels of research.
Yet it remains that chatgpt has no notion of « truth » or information quality. Whereas google has built a whole system of ranking reliable source of truth for every possible subject. I’m not sure a language model can reach that goal, but i may completely wrong.. It’s going to be fantastically interesting !