This feeling makes my Bose unusuable unless I'm listening to music. They always default to noise-canceled enabled when you turn them on. So every time you turn them on, you have to disable noise-cancelling in the app.
I ordered some AirPods Pro, so hopefully that feeling doesn't exist while using the noise-canceling. At least you can disable the noise-canceling without opening an app.