> creating a super-optimized tight loop of a program in C++, C or (better) assembly might be much easier to do than in higher level JITted languages

Sometimes, the situation is exactly opposite, though:

http://pzemtsov.github.io/2014/05/15/how-to-make-C-as-fast-a...