This truly is amazing.
I've noticed that GPU does help a lot with inference. It would be nice if it were easier to make projects like these mobile.
Google and Apple have SDKs for running nets on phones, but its a shame its so hard to do things like this on the Raspberry pi...