Very interesting idea. Maybe you can add human in the loop ranking for CVs, which can be used to further tune the AI.
Another direction is introducing a “hidden preference” layer. Right now, the AI ranks candidates based solely on the job post — which applicants can see and potentially optimize for. Hidden preferences could let the model learn from team behavior without exposing that data, making evaluations more accurate.