The same gravity that wants to pull you in keeps you in orbit. And any object we launch starts off in the suns orbit.
I would say it's your velocity that keeps you in orbit. Without the velocity, you fall into the star. Without the star's gravity, you keep going away in a straight line. Any object we launch starts off with Earth's velocity.
Your lateral velocity is what keeps you missing, whether you want to or not.