This is one of my favorite parts about working for a CDN with tens of thousands of servers around the world… the challenge of designing systems that will encounter rare events all the time.
Race conditions just become conditions, because they will happen all the time. It has never been more important to know which syscalls are actually atomic and under what conditions that holds true.