Let me add another suggestion: http://www.sikuli.org/

Originally developed at MIT, now freely available and maintained as open-source lib. It offers advanced (partial) matching at the UI level.