Heroku XL: Focusing on Large Scale Apps
blog.heroku.com
blog.heroku.com
One also pays quite a high tax to use, say, Ruby vs, well, just about any other language implementation except for Python and non-HHVM PHP (see for example http://www.techempower.com/benchmarks/). Many would defend the use of Ruby as entirely justified on the grounds of productivity.
The point is, there are inefficiencies all over the place and most consider them not worth optimising out.