Wow this is great! I think this is kind of the future of automation and "computer use" once LLMs become powerful enough.

Every task on the web can be reduced down to a series of backend calls, and the key is extracting out the minimal graph that can replicate that task.