> Tensorflow serving is barely controllable, and requires insane tuning to make it perform the same as pytorch

What are you using for serving PyTorch models?