Biggest thing for me was pinning CPU governor to performance and disabling turbo entirely. Slower numbers but they stop drifting as the box heats up. Also isolcpus for the load generator, otherwise you're benchmarking your own noise.
Turbo only possible to have enabled while benchmarking if you have hardware good enough to cool down the server