It’s because it’s from the French (if you say the plural with a French accent, it all makes sense). There are a handful of other cases in English, though none spring to mind this morning.
Courts martial.
Daughters-in-law.
Passers-by.
Professors Emeriti.
Secretaries general.
Agents provocateurs.
That said, I so want to be a part of the last group.