I'm not really making a claim that the average voter is "as good" as an expert when voting. Rather I'm saying it's often not possible to optimize anything in the context of voting, so the degree of someone's expertise in some domain is really not relevant to begin with.