If you dig this stuff then Real-Time Collision Detection[1] is solid gold. It's basically data structures for 3D along with a practical appreciate of what makes real world algorithms fast(data layout).
http://all-things-andy-gavin.com/2011/03/12/making-crash-ban...