This sort of happens already in NBA games. There's a system called SportVU that tracks XY positioning of players and XYZ positioning of the ball in real-time. Here's a decent article that describes it in more detail: http://www.fastcodesign.com/1670059/moneyball-20-how-missile... . Unfortunately, the data is proprietary.