The context is the input to the LLM model. It seems like you need to study up on how LLMs work, instead of spouting hype.
First, the "hype" is not externally imposed. It's the genuine reaction of hundreds of millions of people to a technology that would have been considered science fiction just four years ago. The fact that I can't be certain you whether you are an LLM or a human is incredible.
Second, the output of the LLM depends on both its weights and the context. If it has seen something in its context window, it now knows it for all intents and purposes. It learns, in other words.