When you learn to ride a bike, you're simply training the feedback mechanism. Much like a PID controller, your brain has to keep track of the amount of error and null it out with proportional and integral terms (at least). Once those constants are dialed in, it's "just like riding a bike" -- they're yours for life.
Then there's the matter of learning which way to lean so that the gyroscopic instability inherent in turning doesn't send you into the nearest ditch...