Have you been tested for Autism/Asperger's?
I ask because I am on the spectrum and have a similar anxiety with how people will think of me during interactions. This stems from a difficulty in reading other people. Over many years I have developed internal scripts of standard behaviour for interacting with people in different circumstances. So long as I am able to stay on script, I have learnt to worry less about what people think.