Good point. The project mentions this work which did experiments on sports: http://cs.stanford.edu/people/karpathy/deepvideo/