I think that's already been done: https://en.wikipedia.org/wiki/MuZero