That only works if you believe the skills needed to choose a fund manager are the same skills needed to choose stocks. That's seems unlikely.
If I've consistently picked terrible stocks for years, performing at 20% less than the market, and then I meet a fund manager who has has consistently performed at 20% above the market, are you suggesting I can't know whether or not he's better than me?