Neuro-sama, an AI VTuber streamer, manages to do this.
There are topics brought along multiple streams and manages to remember details of previous streams.
I don't think the results would be as good as they are now - Vedal is bringing his own perspective into it - but once you have a proof of concept, you can improve it.