> They got a bonus of $20 for every question they found where their answer was more correct than the original.

> We need to put care into our systems. We need to build checklists and peer review and resilience into the way we express our carefulness.

Yes – the systems help, but proper incentives are also super important. Granted, designing a system wherein the incentives are properly aligned with the goal (and not easily manipulated; shortcuts can and will be exploited by humans and ML algorithms alike) is no easy task.