Doesn't clang already implement this ?

LLVM can process multiple codegen units in parallel already, and many frontends split TUs into multiple codegen units.