It's cool how neural networks, even convulutional ones, are one of the few applications that you can compute through homomorphic encryption without hitting a mountain of noise/bootstrapping costs. Minimal depth hurrhah!
There are people doing NNs in HE, but most implementations do indeed require bootstrapping, and for that reason they usually use CKKS.