I don't install build-essential on a server, in a container, on a VM, etc. It really matters in those places. If you combine them then you lose the ability to deploy a small rootfs.
Multi-stage builds do make it a bit easier to get rid of them for containers, yes, but during the build stage it's still required.