I recall trying to use GPT-4 to plan a trip through the PNW in ~Spring of 2023.

It presented a reasonable agenda, however 80% of the rockhounding spots were completely made up!

Over time, and as LLMs have gotten less sycophantic, I’ve found myself trusting them a bit more (a dangerous and slippery slope).

With that said, GPT-4o in particular, seemed to rank user satisfaction above truth.

I’ve found that GPT-5 Pro is currently the best at pushing back against silly ideas, and does a decent job of informing me that my questions could be better (: