For what it's worth, Google App Engine uses a so-called "intelligent" global request queue/scheduler. In most circumstances it's quite effective.
http://code.google.com/p/googleappengine/issues/detail?id=78... http://code.google.com/p/googleappengine/issues/detail?id=57... http://code.google.com/p/googleappengine/issues/detail?id=78...
Needless to say, it is VASTLY better than Heroku's router. You'll never see an H12 error with GAE.
Pending latency is exposed as a metric on the App Engine Dashboard.