Just thought I would recommend some reading about this: "The Tyranny of Merit: What’s Become of the Common Good?" by Michael Sandel.
Basically, think about what the longer-term, overarching effects on society would be in a perfectly-meritocratic society. It likely wouldn't be all unicorns and rainbows.
Here's a review about it: https://www.harvardmagazine.com/2020/08/montage-michael-sand...
May not change your mind, but we should always try to expand it :)