New paper finds that:
1) Model mistakes are getting similar with increasing capabilities, pointing to a risk of correlated failures.
2) LLM-as-a-judge is biased towards more similar models
3) Training using another LLM benefits from complementary knowledge