I have type 1 diabetes, and there's studies about this on diabetics actually. There's a huge hit to quality of life and specific kinds of burnout attributed to the thousand or so extra decisions we have to make every day to manage our blood sugar. I'd love to get rid of those, but since I can't, I'm particularly sensitive to bullshit that takes my attention or willpower like that. In my experience, people don't live on a spectrum where "I have self control" = Everything that happens to me I make the right decision even if its hard or "I have no self control" = I always make the bad decision. There's always a pool of decisions, and the further you get into the onslaught of decisions the more you're beaten down and the worse your self-control is.
It is perhaps possible to attain a monk-like state where your will is absolute and you never make any compromises (although I doubt it), but since 99.99% of us will never get there, I think there's a lot to be said for cutting out things that nudge us in the wrong direction constantly