My take was that initially the metric is appropriate, but then with overfitting, it’s not enough.

It eventually becomes a bad proxy metric.