There's TensorFlow Serving [0] and the SavedModel export format [1] to help with this.

[0] https://tensorflow.github.io/serving/ [1] https://github.com/tensorflow/tensorflow/blob/master/tensorf...