>... numpy, scipy, something pandas-like, and of course matplotlib... Where I work, we desperately need a fast python.
It sounds like Julia would be a better fit than Crystal?
Ironically they have similar problems: compile/start-up time (though crystal has working ahead of time compilation - AFAIK Julia developers are still working on speeding up "first run" in various ways).