It became clear to me in the GPT-4o launch that OAI was interested in the "GitHub copilot for everything" route. With low-latency voice mode and the ability to take action on a user's behalf, this will basically feel like pair-programming for everything, or just having an employee who can do everything for you until they need your help or clarification.

To power that experience, an app will need to feel "multiplayer" like someone else is working with you. They'll probably bundle this in the API and have "agent mode" that developers can embed in any app or website, or just let consumers give OAI access to control their desktop. It'll also likely work async, so you can assign tasks, walk away or go to sleep for a few hours, and see the results.

This is speculation. But it feels like the interface that we'll look back on in ten years and say "that seemed obvious in hindsight."