It's a programming language and an associated IDE for doing mathematical and scientific computing. It is similar to Matlab in some ways, although Matlab has a strong "numerical" flavor and Mathematica has a strong "symbolic" flavor.
As a language it use an M-expression-like syntax. See http://en.wikipedia.org/wiki/M-expression