I think a succinct way to put it is: on-the-fly "profile-guided optimization". A good JITter will do this automatically (as you said).