You seem to assume that everyone's brain is like yours. Because we have idiots and geniuses in terms of brain structure, there is a huge variation in how strong someone's prefrontal cortex is.
Actual daily levels of hormones or genetic predisposition have a huge effect on self-control or conscious control.
A relative of mine had a stroke which resulted in the loss of part of the brain. Most people don't have such a drastic stroke, but it's enough if you're born with a different gene and you have a slightly different connectivity in your cortex to not have as much self-control as the next person.