Have you thought about this kind of thing and the type of user participation that you'll encourage?
Tim & Nina actually took the same approach originally by sending surveys out to people they thought would have valuable opinions and rewarding them with a printed guide.
I find The Wirecutter / Sweethome to be really great for consumer reviews. Specifically, because they’re transparent about the qualifications of the reviewer, and transparent about the criteria on which their subjects will be evaluated, including “we interviewed X, Y, Z and they identified a, b, c as the most important metrics because of R.” So I know why I should trust the author, their metric choices, and the results - which makes it easy for me to decide whether their judgment reflects my own priorities.
That seems like a lot more effort, in a distinct vein, than the usual restaurant review. Food is, of course, more subjective but the usual review seems like a highly evolved version of “I liked this.” I don’t care if a reviewer “likes this,” I want to know if they liked it —and- an indicator of how or why to generalize those results to my own tastes.
That said, better restaurant reviewers do try to explain what they liked or didn't like about a dish. But most people are not better restaurant reviewers, are often basing their opinion on just one visit, and are often writing short reviews that are in a different category from a New York Times reviewer writing an in-depth review after going to the restaurant three times.
https://www.quickanddirtytips.com/education/grammar/conscien...
I'm very interested how this works. I know someone at the big telco company I can't tell name here that was approached about years ago by Google in terms of selling of gmail. But the deal eventually fell between cracks as the price Google wanted for just mailboxes was too big.