I find Bayesian regression models are actually simpler to explain as the assumptions you make are explicit and part of the model specification.

(Thought the actual sampling mechanics and tooling can be much more complex)