TF Lite supports Android NN API that allows each phone to accelerate these models leveraging the custom accelerator on the phone.