hi OP. We built an open-source library called, BentoML(https://github.com/bentoml/bentoml) to make model inferencing/serving a lot easier for Data scientists in various serving scenarios.
Love to hear your thoughts on our library
I was really hoping that you where about to offer an ML framework to improve spelling.