>there’s a serious push to on-device inference

What push are you referring to? By whom?