See the opening video (https://www.youtube.com/watch?v=wiOopO9jTZw&t=268), where I mention that we "coach" it on what we think is good and bad. All the heavy lifting is self-play (which I would characterize as supervised).