I think this overlooks the fact that mathematics is very specialised, segmented. Enormous talent in one strain of maths does not mean that anybody, following a slightly different course, would recognise the talent.

So, being an arbiter always means disappointing someone.

I suggest several micro-Fields medals, each arbitrated by the cross-cut of the nebulously defined experts of this field.