It blows me away that an object can go from standing on the ground to being in orbit in less than 10 minutes.
At 21,000 meters, the U-2 didn't fly that high. That's only a half marathon, and many people can run that distance easily.
In other words, I fail to understand your point, even omitting the 7.9km/second sideways velocity for LEO.
Most of the difficulty to orbit isn't distance, it's the amount of energy it takes to get something moving that fast.
Actually it's much, much worse than that, because it's actually the change in momentum involved.
I think it's logarithmic, but my math is bad.
The problem is the rocket equation. Yes, there's a natural log in there, but working against our favor.