Isn't this state of mind kind of dangerous ? Like a self fulfilling prophecy?
Perhaps a good example of a positive "not caring what others think" might be dancing however you want; you don't feel embarrassed because you're not a good dancer you just do whatever.
Perhaps another good example is Bob is a vegan and hates that you aren't; now you don't really care anymore and can focus on eating the food you want to. Flip the roles, Bob eats whatever he wants and hates that you're a vegan; you again don't care.
If one is required to be concerned with not "being an asshole", how are risky ventures ever undertaken?