Ask HN: Quintessential readings for software optimization
What are some of the best resources for getting more familiar with stuff like playing nicely with branch prediction, instruction pipelines, and building data to fit well in with CPU cache?
https://lwn.net/Articles/250967/
AFAIK there have been no major breakthroughts since that time in memory technology (Transactional memory could be one). While modern processors may be build a bit different (e.g. added shared L3 chache) you will have no problem understanding them.
There is also this github :
https://github.com/Kobzol/hardware-effects
for programs which should show such effects. (I haven't used them yet but they may be interesting for you to play with.)
IT Hare has published a nice article about those costs including rules of thumb costs.
http://ithare.com/infographics-operation-costs-in-cpu-clock-...
Then there are the Agner tables. Giving you latencies and reciprocal throughput for your instructions.
https://www.agner.org/optimize/instruction_tables.pdf
If you are through these you have to read the intel and AMD optimization guides. (ARM may or may not have something similar.)
The paper by Kazushige Goto ("Anatomy of a High Performance Matrix Multiplication") is an example of Cache and TLB considerations in a non-trivial example.
http://www.cs.utexas.edu/users/pingali/CS378/2008sp/papers/g...