LLMs don't have super memory like that. I mean I don't know what this internal OAI model is, but at least for other LLMs, they aren't databases of training data with a smart search on top.
I'm fairly sure your understanding is not fully accurate.
And then they are for sure able to fill their context based on 'smart search on top' to actually progress further.