Right now, DataFrames is handicapped by problems with how DataArrays was designed. With some revisions coming in Julia 0.4, it should be possible to fix a lot of the worst problems (esp. performance) with DataFrames.
I think that being not faster than Pandas is pretty good, since it is written in C and heavily optimized.