The rustc binary should run on any modern glibc distro by default and there is builds for other libc libraries too. It's not purely statically linked, it does run against glibc and pulls in a few other dynamic libraries, but most of those should be present if your system can show a TTY with a shell. I'd recommend using rustup to install the newest toolchain (and avoid pulling in an old one from your package manager, rustup can install older toolchains for you and manages it better than your distro with high probability)