I'd love to use such a service, but for free. Ex: you get karma by giving your A/B preference, that you can then spend later in getting feedback yourself.