Gemini is kind of cooked. It's a personality hire.

I did try asking Gemini and Claude "what would a unicorn taste like" and got… acceptable and accurate answers, but the accurate answer maybe wasn't "acceptable", because I don't think a little girl asking Claude that question should have gotten a long description about what horse meat tastes like, like I did.

So there of course are issues where an LLM having explicit knowledge about something doesn't mean it has tacit knowledge about it in all contexts, but also hiring the LLM to do a job of being a helpful harmless chat assistant constrains its abilities.

(Gemini also points out a Starbucks unicorn drink doesn't taste like horses.)