I have complicated feelings about this. I also watch most things with subtitles these days, because either (or probably both) my hearing is going a bit or sound design/editing in films and tv shows has gotten worse, but there is a non-trivial difference in how I perceive things with or without.
With subtitles my eyes are drawn more often to a part of the screen where nothing visual is happening. They aren't glued there, but it does create some bias. I have occasionally rewatched a scene without subtitles and noticed a lot of subtlety in the performance I had missed the first time though.
That said, a bad dub is at least as distracting. Probably much more so, if anything. I would rather watch a bad sub than a bad dub, though I have occasionally enjoyed dubbed things as well. I don't think it's an all or nothing thing, but "never watch dubs" is the hard line heuristic that makes sense to me if you're gonna go that way.