I know because I've been there; even if self-esteem reinforcement looks like simple and obvious ideas, it helps if someone tells them aloud to you. Irrational behaviors are not solved by reasoning them away, you have to practice how to fix them.
It made me even more insane how I could wave back and forth that much. It's also telling that a big chunk of it is due to how you perceive you relatively to the env.
All in all I wouldn't say it's all in our minds, even though we inherit genes and traits from our family but as you saw yourself, it's also a balancing effort with our surroundings. If you're misjudged you will face an uphill battle, if you get a friendly start it will change our you feel, live and create your persona.
One central message [of his book, "Discourses, Fragments, Handbook"] is that the basis for happiness or well-being is 'up to us' and that we all have the capacity to move towards this state, regardless of our specific social context or individual character. [...] Epictetus also stresses that this capacity forms an integral and inalienable part of what makes human beings distinctive in the natural universe, as well as the prime expression of what is 'divine' within us.