No, you can of course write some simple stretchy model that fits fast. The thing with NNs is that you don't have to domuch work to get a good fast model, you use cpu cores for that instead.