This particular shortcoming of is why I wrote https://github.com/rhardih/serve back when.

These days just using `caddy` might be easier though.