Microsoft's PGO/LTCG implementation does just this. GCC can do something similar as well.