I hypothesize that the source of most anxiety or nervousness stems from our brains making no correct predictions in that moment. This is supported anecdotally by my patterns for overcoming social interactions that used to make me anxious that I've now become comfortable with. My brain now makes enough correct predictions that I don't feel the need to leave the situation.
I hypothesize that part of why I started acting on my transgender feelings was because I'd become so uncomfortable in my own body that my brain wasn't able to make accurate predictions about the sensations coming from my within. This is supported anecdotally by the following.
I started 2 activities when I accepted my desire to transition to female. Both were touted at reducing the feelings of un-comfortableness in my own body. Female to Male hormone therapy and taijiquan. Both produced lots of new feelings for my brain. Both gave me a sense of agency over my own body, the understanding that I have the ability to shape my body into what I want. In the end I stopped transitioning because taking the hormones(mostly the T blocker) isn't known to be healthy for the body(Liver/Kidneys). Taijiquan is almost unanimously a positive source of change in ones health for the rest of their lives therefore I choose taijiquan and a long healthy life over my desires to have female genitals. Practicing Taijiquan makes me feel better, and in regards to my gender dysphoria taijiquan has cured it; I am very comfortable with my male genitals now that I'm able to make enough consistent predictions during sex to remain engaged with the situation and remain turned on.
Edit Addition: I'd like to state that I still identify as a cross dresser and I'm comfortable saying that love certain parts/styles of womens fashion and accessories. Example, I love long flowing skirts. As a society I feel we should reassess men wearing skirts as it is much healthier for our genitals.