I don't see what you get from asking people what they think they'd do in certain situations, when you could instead use the actual outcome of the hand as your training labels.
But I think it's worth looking at to only use hand histories and if possible only validate when something unexpected results. Maybe then I could use the human input to validate the computer's decision. I'm still hashing that out.