S-tier comes from games. An A to F scale with S representing a "super" or "superior" rating has been around in that space quite a bit longer than LLMs.
In Japan the "S" is explained as shū (秀) "Exemplary, excellent".
https://en.wikipedia.org/wiki/Academic_grading_in_Japan
https://en.wikipedia.org/wiki/Academic_grading_in_the_United...
- the greatest heroes are in the S-Tier
- A ranking heroes are the second best
- Then B, C, D, E, F....