Why do machines learn, at all?

Author: This is a condensed version of a discussion taken from my thesis that I had wanted to write down on the blog for some time. I hope it is a somewhat interesting read! Cheers