I agree, the real deal would be an AI assistant that actively learns and remembers everything important about you, and can access and utilize all that information when having a conversation, while also having access to external services, your calendar and so on.

I wouldn't be comfortable running that as a cloud-service though. Should be open source and run at home on my own machine.