A poor analogy. VC is more like putting 20 horses in a race, hoping that 1 horse will win billions of dollars. The other 19 horses usually make approximately $0 in comparison to the winner.
VC is not zero-sum. Most sports are zero-sum and most sports betting is worse than zero-sum due to house take and taxes. Using sports for analogies with business often gives invalid intuitions because of this.
I think you are also making a fat tail error, the opposite of survivorship/selection bias[1]: you see heaps of failures so you are not properly offsetting correctly for the small percentage of big wins which is the theoretical modus operandi of VC[2]. A majority of VC funds fail to return enough for their risk, but that alone doesn’t tell you whether investing in VC funds gives a poor return: perhaps one VC fund returns 100x, perhaps an investor is willing to pay for investment diversity, perhaps other reasons to invest in what superficially appears to be a poor performing sector.
[1] https://en.m.wikipedia.org/wiki/Survivorship_bias
[2] https://techcrunch.com/2017/06/01/the-meeting-that-showed-me...