although I have not used app engine much, it seems like you would have a lot less flexibility if you use it rather than EC2/Rackspace.

Also, Im not sure I believe statements like "its nice not to have to worry about scaling", although if it is working for KA at hundreds of requests per second, maybe it is an accurate statement