Yeah, that's happening right now really? There has been loads of developments in the mobile space already, in many ways lower powered arm devices are way more optimised for AI applications than the current crop of intel machines.

This example, whilst impressive, feels way more in the "Doom running on a calculator" vein of progress though.