I feel like I’m missing something here. How would having a library on the system help with serving zstd compressed assets?

Browsers benefit from having a deep integration into the http stack. You could build a browser around libcurl, but none of the majors are built like that.