I couldn't agree more, I started building a ML hosting platform to solve your second point. I'm thinking of building a managed NN service as it is a common pain point.

https://inferrd.com