I tend to agree for a lot of queries.
For example, I just got curious and asked Google how many oranges in a cup of juice. The main result is a conversion of a cup to cubic inches, for no reason. Scrolling down a bit, the first usable answer was a quora blurb.
ChatGPT told me it depends on the size and type of orange, but generally 2 to 4.
Guess which one I'll use next time?