Hah, I had never realized that, but after some digging it turns out you are absolutely right. In fact, ‘premise’ and ‘premises’ have actually very different meanings.

This article summarizes it nicely. [1]

[1] https://www.govloop.com/on-premise-vs-on-premises-the-debate...