Very nice work. Glad to see both classification and regression treated very well, with careful attention to design to make something that is easy to understand.

Now the question is - can we build on this (or do something analogous) for tree ensembles? Random Forests, Gradient Boosted Trees etc. Quite common to use that to gain predictive accuracy, though interpretability/explainability tends to suffer considerably.