I thought that the main disadvantage with flying wings for passenger traffic was that any kind of roll is made much worse the further you get from the main roll axis, so turbulence etc becomes more uncomfortable in the wing part.
Also, anecdotally from my flying (I'm a private pilot, small, single engine planes) turbulence tends to create much more vertical translation and pitching movement than it does roll movement.