I would imagine that the current limitations on doing something like this are related to the maximum weight a hot air balloon can lift, in addition to the untested physics and engineering of a mid-air space launch. Imagine if SpaceShipOne (which was launched at 13.3km) could be taken to 40km and then launched.
Perhaps someone with a better understanding of lighter-than-air lift physics could explain what the current limitations on this are.