In fact with your exact proposal, assuming everyone has a connection with at most (say) 50ms latency, no one will join the batch in the first 50ms, which (I think) magnifies the low-latency advantage.
The advantage of speed or waiting until the end is mitigated as you can receive no additional information either way.
If the delays are randomized then you have as good as chance of getting them as your competitors. On delayed times you will have a bad chance of winning, but in comparison to others with the same delays your latency beats theirs, on non-delayed times your latency beats non-delayed competitors and really beats delayed competitors.
Thus in the end the best latency should win biggest on non-delayed trades, and on delayed trades lose least.