I think they tend to pride themselves on their service (which is pretty good I guess.. the tech people you talk to at least seem to know what they're talking about), and they emphasize their scalability. I'm not sure if those things justify the price, but I guess some people think so.
That's all I've figured out myself. Too bad no MediaTemple users have commented ... I'd honestly like to know what keeps people using them at their price!