Computer program that learns to play classic NES games

Algorithm starts working at 7:38 - http://www.youtube.com/watch?v=xOCurBYI_gY&t=7m38s