Should SaaS startups offer on-prem?

Here is a reasonable answer to the title question:

At the beginning, definitely no.

Eventually, once there is a mature engineering org in place: maybe! There can be great long-term valuable enterprise and government customers available to serve with an on-prem (or customer's-cloud) solution.