It is not old school, this is my daily job and we need even more of it with the NN models used in MPC.
How do you handle that sort of thing? Maybe main process then leave some relatively small residual to the NN?
Is your poking more like "fuzzing", where you just perturb all the input parameters in a relatively "complete" way to try to find if anything goes wild?
I'm very interested in the details behind "critical" type use cases of NN, which I've never been able to stomach in my work.
Faster time to market/production is for us the main reason/advantage of the approach.