But you can absolutely use an aircraft to gain height and speed, and then launch a much smaller rocket from that aircraft (where the speed is the primary advantage, and is what rockets use most of their fuel for). This setup is used by Virgin Galactic's SpaceShipTwo. There is also Virgin Orbit's LauncherOne, which is a small rocket that launches from a modified Boeing 747. On Earth it's just about not worth the additional complexity, but on planets with stronger gravity but comparable access to powered flight this might be the preferred method of reaching space.
One important factor might be the speed of sound. Subsonic flight is much easier for aircraft than supersonic flight. In an atmosphere with a much higher speed of sound, like say hydrogen, aircraft could reach much higher speeds and thus would be a much more advantageous launch platform for rockets. Assuming you already solved the issue of powering those planes of course.
This all adds up to a plane needing to carry many times less mass to gain the same altitude and speed as a rocket, at least within relatively dense atmosphere.
Pegasus is an orbital rocket launched from an aircraft, but it doesn't exactly impress with performance or cost-effectiveness. Just doesn't make much sense to operate a huge aircraft and design your system around it just to improve on the least important 10% of the flight.
However, past Jupiter size the mass keeps increasing while the radius doesn’t, so even from a floating platform you’re contending with multiple G’s.
Yes, you could use a balloon filled with vacuum, but lifting something the size of an orbital rocket in a hydrogren atmosphere would require a vacuum chamber at least the size of a city, possibly the size of a small state. It would probably be easier to build a tower.
The atmosphere gets denser further down. You just need a negative pressure vessel, or to heat the hydrogen, like a hot air balloon. At 1 (Earth) atmospheric pressure the gravity of most Gas giants is quite low.
It's hydrogen inside an oxygen atmosphere that's the problem.
(So on Jupiter, you wouldn't want to ride in an oxygen balloon, ie you wouldn't want to ride in a hot air balloon there.)