looks like they have since fixed the dataset, hope they release an updated report (either without the leaked evals or a new checkpoint/weights)

https://huggingface.co/datasets/AIML-TUDA/QA-base/commit/2f9...