Right, so you need to end up creating a container to package the glibc with the binary. Which is not very different from having sysroots.
But what about any tools compiled from source and used during the build? Those can also suffer from these issues.