We tried that, wasn't a big lift to setup and tested. We used 1000 detections with at least 4 crops, and it made a bit of a difference but not much - our conclusion remains the same.
No, that is a really great point. The ICPR competition the big winners were all about multi-frame. Will do some more experiments and update.