I never even thought about this being a problem until I watched the video. It's amazing the types of things we have to build algorithms to handle that our brain does naturally.
So yes, brains are incredible in what they can eventually achieve, and the fact that the calculation involved becomes hidden from conscious awareness can make it seem "effortless", but when you consider the sum of time and effort spent practicing physical tasks over a typical human lifespan, it's really anything but.