Reminds me of this tweet [0]:
If 1 million tokens is a lot, how about 2 million?
Today we’re expanding the context window for Gemini 1.5 Pro to 2 million tokens and making it available for developers in private preview. It’s the next step towards the ultimate goal of infinite context. #GoogleIO
In theory, if you have an infinite context, you could build an AI assistant which accompanies you throughout your whole life and would have all the info on what you've done at your disposal for immediate query or discussion. Also, in theory, if you'd then die, the world would have a digital replica of you up to the point of your death.