There are two books which do a fantastic job of this:

Mathematics: From the Birth of Numbers, by Jan Gullberg

and

Mathematics: A Cultural Approach, by Morris Klein