With learning-based program optimizer, we can competitive performance on benchmark models and significant boost on emerging models against TensorRT(int8).