I'm not aware of anyone using Mathbox in Observable, although it certainly seems promising!

On the other hand, I have seen quite a lot of neat Ganja.js notebooks float by, for plotting explorations of algebraic spaces in notebooks: https://observablehq.com/search?query=ganja