I understand that it takes a ton of background and expertise to understand a paper in a specialized field.

You do not need a degree to gain that expertise, however.

Further, having the degree is not a reliable indicator of expertise, in my experience.