Those are disanalogous in the case of theoretical physics where you don’t need access to any expensive equipment. There’s nothing in principle preventing someone from learning math and physics on their own or from a traditional university and then coming up with new theories alone. And in fact this happens all the time and most of those people get called crackpots.

A better analogy is asking why someone who is bad at baseball isn't on an MLB team