That sounds like an interesting idea, thanks! Can that '--target-dir' argument be added in the build.rs script?
[build]
target-dir = "/home/user/build-artifacts"
But I don't know if the different projects will trample each other that way. If that's the case you could just go with a .cargo/config per-project targeting a subdirectory of the build-artifacts directory.