Along the same tangent, Eigen has pretty much the nicest API for matrix math, in C++. Additionally, it is totally template based, and allegedly compiles to some highly optimized code. Even without that, it's a huge step up from the likes of GSL or clapack.