We had to decide whether or not to drag our pet to an after hours emergency vet, with all the associated stress and cost, or ignore the AI result and go off everything else we were reading. It's one thing to dismiss AI answers that seem wrong when it's a domain I know well or the stakes are low, but this was not that type of scenario.
In the end we opted to ignore google's AI and fortunately it was absolutely the right call. So, thanks google.
So, at the end of the day Google's AI is better than ye olde Google Search, and ye olde Google Search is now very difficult to accomplish because of how much Google has poisoned the well. Kagi is excellent but most normal people can't stomach paying for search when there's a "free" alternative so your options are Google's AI, Google's Search or and alternative search - most normal folks don't realize non-Google search alternatives exist (outside like Bing) so Google's AI ends up capturing a lot of usage.