Ooh, this seems interesting ! I'm working on tracklab (https://github.com/TrackingLaboratory/tracklab), I might try to implement this in the visualization pipeline, which needs some work right now.
What can I potentially get out of VidFormer when there are a lot of annotations to show ?