But in a plane the background isn't moving... it's the inside of the plane, which is always stationary at least with regards to the passenger. I'm not saying you're wrong, I'm just saying you shouldn't need that even on planes.
Travel mode apparently switches it to track primarily with vision. So it can work as you say.