Exactly. And optimized Haskell doesn't quite look to "that beautiful FP language" anymore, but becomes more imperative.
Idiomatic Haskell for most of my code and imperative Haskell for performance achieves something similar without having to switch languages.
If you really need C, Haskell also makes it pretty easy as well.