Now, ChatGPT can see my screen. Should I build this out? [video]

I'm trying to decide if it's worth cleaning up the code and publishing this. Is it something that would be interesting to others? It's still pretty buggy, in part because ChatGPT itself is buggy, particularly these past few days! But also, I have to regularly refresh the chrome tab when mic access or audio playback stops working. It's going to take some effort to make this thing more reliable. I need to better understand how the background page & service workers works with Chrome extensions.

This project started after I tried a bunch of Chrome plugins that let you speak to Chat GPT. The one I liked best was this one: https://github.com/C-Nedelcu/talk-to-chatgpt

I forked the code and refactored it quite a bit in order to improve the voice recognition, improve the quality of text-to-speech (using WellSaid) and then I added the screen capture capabilities. That's when it started feeling truly magical and useful to me.

The biggest issue is that ChatGPT is still too slow, but Sam Altman claimed during devday that improving the speed is the next biggest priority for them.