This is very cool! I was messing with some browser automation (Playwright) via GPT recently.

One idea I had: it would be cool if I could teach the agent. For instance, give it a task, but if it struggles, just complete it myself while the extension observes my interactions.

Perhaps these could be used as few shot examples for priming the model?

Gonna play around with this soon!