Hacker News Reader

bravi! the future is the Agent OS - How robust is the UI element detection and interaction across different apps and inside navigating complex menus? Is it resistant to UI changes? That's often where these automations get brittle.

thank you e forza Cua

View on HN

UI detection’s a big focus - we use visual grounding + structured observations (like icons, OCR, app metadata, window state), so the agent can reason more like a user would. It’s surprisingly robust even with layout shifts or new themes

Reply on news.ycombinator.com