What they mean is by "moving so fast" is, it's moving so fast
horizontally. Imagine being at the top of a steep mountain and throwing a rock directly out from you. The rock will continue to move horizontally, due to the force behind your throw, as well as vertically, as it drops due to gravity. If you don't throw it hard enough, then the trajectory of the rock won't clear the mountain slope. If you throw it too hard, it will clear the base of the mountain by a wide margin. But if you throw it just right, the rock could hypothetically have a trajectory that is perfectly parallel to the mountain slope (in reality, due to things like air resistance, this isn't all that feasible).
Anything in orbit it literally the exact same. You get something moving fast enough horizontally that even though the Earth's gravity is still pulling on it, its trajectory towards earth is perfectly parallel (actually often not perfectly, but in principle) with the curvature of the planet. But by doing it high enough in the sky, you can escape the atmosphere of the earth, to where there is no wind resistance, meaning once you get up to a high horizontal speed, you can turn off the engines and coast perpetually without slowing down.
So everything in orbit, from the ISS to satellites, to the moon, are all in Earth's gravity well and are falling towards the planet, but they have a horizontal speed as well that keeps them from colliding with the surface. The Earth and the rest of the planets in the solar system do the same thing in terms of their orbit with the Sun.
It's also why sometimes satellites or space junk that have been in the sky for years will come crashing down to Earth. Sometimes the calculations for how fast you need to be going are off, or something will throw off it's horizontal momentum, and that will cause it's trajectory to dip just enough that it is no longer orbiting the earth perfectly, but instead is spiraling ever so slightly towards the surface, and will over the course of months or years or decades dip closer and closer until it enters the atmosphere, at which time air resistance becomes a factor again and it breaks up and really plummets.