Sugar in bread is so nasty to me. I can't stand to eat it, yet it's in almost every loaf on the shelf at a supermarket with 50 types.
If you think that's not true, simply take a sugar-low bread (check the food label, don't just go for organic/whole-grain, those usually have more sugar) and taste it for a while in your mouth. You'll notice it starts to become sweeter in your mouth.
As long as you stick to proper bread without the crazy added sugar, and preferably whole grain (actual whole grain, not just marketing "whole grain"), it's not an issue. Unless you try to subsist on literally only bread, of course.