I think providing more information on the questions for Candidate 2 would be pretty helpful. The description is really vague as "easy" and "hard" could mean different things to different people.
I think gathering enough trust where people start accepting these dossiers as fact will take a long time unfortunately. But if you have a recording of the interview, I would be able to say a lot more definitively whether I liked the candidate or not. And as my opinions aligned with your dossiers, I'd trust your opinions more.