I use Nix to manage my machine learning development environment: https://github.com/nixvital/ml-pkgs

Sure after the building the binary is HUGE. But I only have to build it once and cache it so that all my workstations and training servers can use it.