No offense but just "running a neural net" is rarely trivial
Hell, I’m not an ML practitioner and I almost never use python, and yet it took me maybe a day or two learn enough about covnet training to detect my dog on a home security camera.
All you have to do is multiply each weight and add up each node.
Pure bulk arithmetic is both simple and a perfect match for FHE.