That is a great point! Similar to admissions tests to a college I suppose.
> Their activity might be mostly in a natural language you don't understand, and how could you evaluate that fairly?
Good point as well.
> That said if a candidate provides their GitHub or other portfolio then I think you should consider it just like any other part of their resume, not to replace the coding challenges but as part of the chat about past experience.
I think I understand. Would it be fair to say that, you consider the the "score" of the coding exercises as weighted higher than potentially significant contributions and maintenance of open source projects _because_ they are normalized?