This isn't really innovative, good idea its just done already.

Selenium does this for browser based apps. Autoit does it for most windows apps. There are more depending on your particular os/language needs.