Orbit is not about height, it is about speed. You have to get to almost 30km/s otherwise you aren't in orbit and you fall back into the atmosphere.
The point still stands, though, you have to get to nearly 8km/s otherwise you aren't in orbit and you fall back into the atmosphere.
You can't get to anywhere near that speed while still in the atmosphere - SR-71s only manage about 1km/s, and because kinetic energy is proportional to the square of the speed, at that point you are only 1/64th of the way there.