No mention of math formatting but from the docs it looks like there is TeX support!

https://observablehq.com/framework/lib/tex