Model Serving with TFX

In this article, we will talk about:

What is Model Serving?

What is TensorFlow Serving?

TensorFlow Serving architecture

How to set things up with TensorFlow Serving?

Installing Docker

Installing TensorFlow Serving

Building an image classification model

Serving a model with TensorFlow Serving

Communication protocols

Creating gRPC and REST endpoints

Making a request to the model

Challenges of working with TensorFlow Serving

Common errors you might face when working with TensorFlow Serving

Best tips, practices, and gotchas when working with Tensorflow Serving