Yep, we arrived at my larger point: if you care about interpretability, NNs are horrible and Bayesian techniques are pretty damn great.