KaTeX supports server side rendering to an html string. If you do this, the client only needs to load the css component of katex, and not the js component.

I believe MathJax has a similar capability.