Haha, we definitely used profiling tools. :) Perf is great and definitely the first tool to use. I know vtune has been used as well.