Some of these large models are able to do zero shot learning and perform tasks they weren't explicitly trained on since the training objective is very general.

Being able to perform more advanced types of zero shot learning tasks would be comparable and further the accuracy on those tasks can be evaluated