Cloud Foundry (and things like it) does a reasonable job of separating those things for "applications", ie web apps, pretty well, but didn't have an equivalent for data services. Nobody was quite sure what it should look like.
I suppose part of Kubernetes's success has been that it looks like a solution to this. I'm not sure how well it really works, though.
If something like this worked, it would technically enable a marketplace model, where AWS or GCP do their efficient hardware thing, then the software experts provide a value-added service on top of that. What we would then be missing is a way to economically enable that model, where it doesn't make sense for AWS etc to just provide their own version of the service and capture all the profit.