I'm thinking about buying a personal voice recorder and keeping it on me 24/7. I could run the audio through Whisper every day and then slowly build up a database of facts that I could query. Like every day if I learn someone's birthday or meet a new person, I could quickly say "I met XYZ at the meeting and we talked about AI bots. Their birthday is May 11th", or "remember to pay the phone bill on the 21st of every month". And then every day the assistant could query that database and tell me who's birthday it is, or which task I need to take care of. If it was realtime then we get closer to a "Her" style AI assistant.
The biggest issue I have is with the models being cloud hosted. I want to own and control all of my data especially personal things like voice recordings... any company will promise the moon when talking about their data security, but we should be 100x more worried about the risks in the long term.