I'm glad every scifi movie and TV show's sound designers decide to ignore reality and make it interesting. It wouldn't be the same without the whoosh and rumble.
Not every movie and TV show.
You are right though that that it wouldn't be the same.
R.I.P Firefly.
If you don't have that, you're a little more limited to relying on visual information for everything