Experimental Evaluation Methodology for the Era of No Steady Performance [pdf]

Oh my. It gives me headaches to think about what "no steady state" means for the statistics of benchmarking and perf optimization.