Sure, it's more effecient to have it use an API. And people have been integrating those for the last while.

But there's tons of applications that are locked behind a website or deckstop GUI with no API that are accessible via vision.