But the prompt didn't give the models the option to say "I don't know", so it wasn't a measure of their confidence.
You can argue the study isn't as case-closed-decisive as we'd ideally like, but it's certainly evidence. It's probably hard to design a better study.