Check your orbital velocity at the surface. It's not 0. The direction you head does matter.