>small enough to fit entirely in the L2 cache

Shouldn't the "hot" path fit in the L1 of a "modern" processor (100 kB+)?