Other than that, I like the App Engine architecture much better than Heroku's, although there's a lot to like at Heroku as well.
The good news for app engine is that Google has announced planned support for this (1) feature in their roadmap (2). Allowing us to pay to reserve an extra JVM at all times would eliminate the issue.
(1) http://code.google.com/p/googleappengine/issues/detail?id=24... (2) http://code.google.com/appengine/docs/roadmap.html
I have spent quite a lot of time trying JRuby + Sinatra + AppEngine. Lots of good work but not really ready. Google needs a paid for option to always keep at least one JVM for an application spun-up.
Note that for JRuby on AppEngine, you need to use DataMapper (instead of ActiveRecord) -- that actually looked pretty cool.