> I always thought that it's just harder to extract facial features from an objectively darker image.
Amateur photographer here. The key thing is to ask why the image of PoC is "objectively darker", and the answer to that is because exposure meters/auto programs in cameras are calibrated for correctly exposing white people.