Monte Carlo Tree Search uses Machine Learning indeed! The balance between exploration and exploitation of the game tree is achieved using "bandit" algorithms (a type of Reinforcement Learning algorithm). I recommend reading (Kocsis & Szepesvari, 2006): http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.102....