Bicycles achieve balance because the rider counter-steers to prevent the bike from falling aside.
Destin from SmarterEveryDay had a friend build a special bike where the actions of the handlebar are inverted: when you turn it to one direction, the front wheel turns in the other direction.
It's impossible to ride such a bike.
Well, not exactly impossible: you have to completely re-learn riding, like you never knew before. Which shows that steering is the core (only?) skill to riding.
It's a great video: https://www.youtube.com/watch?v=MFzDaBzBlL0