It's not very fair to compare Ember's size with Backbone's as Backbone implements just a very small subset of Ember's functionality.
Also, it seems that the sizes are outdated because the latest build of Ember.js is 478KB (see http://builds.emberjs.com/release/ember.min.js).