Most parts of most programs aren't performance centric and can take a hit. As evidence, see all the Ruby/Python programs that have constant penalties that go up to 200 in many cases.
I was talking about pretty realtime applications like games. I'm sorry that was unclear.
In such applications, I wouldn't even want to get the GC penalty, so I'd be constrained to a very small set of languages.