This seems very very interesting. I'm still learning python so probably can't build on this. But like a cheap mans' version of this would be to take a screenshot every couple of minutes, OCR it and send to it gpt for some kind of processing (or not, just keep it as a log). Right? Or am I missing something?
Yes, that's exactly what's happening here, minus the sending it off to a third-party.
I didn't see the benefit when the OCR content is fully searchable, in addition to not wanting to pay OpenAI to spy on me.