Maybe even more powerful would be reducing the number of examples needed to learn, eg less than one shot
https://www.technologyreview.com/2020/10/16/1010566/ai-machi...
updating weights in real time is useless if each update basically does nothing because it takes an insurmountable amount of training, on the other hand if i can give my model a succinct “lesson” i’d then be very willing to wait a while for it to “process”