I don't know if Musl is worth the hassle if one is only interested in the reduced size. I see the point if you have everything statically linked, but with dynamic linking, you have glibc sitting there just once with a few MB, and you don't have to tackle all the issues that can arise when using Musl (e.g., DNS).

Alpine's compressed container image is nowadays something like 3 MB, okay, that's very small, but I wish they had an 8 MB glibc version. On the other hand, there is debian-slim, but it's not as good as Alpine when it comes down to stripping down the size, it still weighs in at around 30 MB. I'm still using it, though, although I think it could be smaller.