I wonder what do you guys think about tool which will be able to automate actions on computer? Like clicking smth, automatically opening the window for me after I type in some request?
Something like hyperwriter assistant but for Mac. Very similar to open interpret but with accessibility option
I wonder what else is there in the space?
1. You have an application open, let's use for this example Apple Notes 2. You ask it to summarize the "Recipe xyz" 3. It will search for the recipe 4. Open the note 5. "Copy" the text 6. Summarize it for you
This is a very simple example and maybe not "cool" enough. But would be great to give it any kind of interface and then do some more "advanced" (for an LLM) tasks.
I think this could be possible with GPT4-Vision, but it would be very costly, for things which you could do yourself with a few clicks and key presses.