HNHacker News
TopNewBestAskShowJobs

ragibson

12 karma · joined February 24, 2025

submissionscomments
ragibson··on Gemini 3 Pro vs. 2.5 Pro in Pokemon Crystal
Yes, at least to some extent. The author mentions that the base model knows the answer to the switch puzzle but does not execute it properly here.

"It is worth noting that the instruction to "ignore internal knowledge" played a role here. In cases like the shutters puzzle, the model did seem to suppress its training data. I verified this by chatting with the model separately on AI Studio; when asked directly multiple times, it gave the correct solution significantly more often than not. This suggests that the system prompt can indeed mask pre-trained knowledge to facilitate genuine discovery."