So whose going to sign up to be on call 24/7 when your physical hardware breaks?
Who fixes Amazon's shit when it breaks at 3AM?
I know there's a threshold where the cost benefit works in favor of on prem, but it's nowhere near most 20 node k8s clusters.
Note that rented dedicated servers are 20x cheaper. What you're talking about, colocation, is 50x cheaper.