Well thinking about it a bit more, it would be so cool if you could

A) somehow continuously interact with the running model, ambient-computing style. Say have the thing observe you as you work, letting it store memories.

B) allowing it to process those memories when it chooses to/whenever it's not getting any external input/when it is "sleeping" and

C) (this is probably very difficult) have it change it's own weights somehow due to whatever it does in A+B.

THAT, in a privacy friendly self-hosted package, i'd pay serious money for