You will be surprised of The Unreasonable Effectiveness of opencv.calcOpticalFlowPyrLK