Testosterone has a lot of side effects people don't like: "male pattern baldness", hair growth pretty much everywhere else, acne, breast growth, changes in libido (either direction). Testosterone has been implicated in reduced longevity in men, too. As you note, it can have significant impact on emotional wellbeing, and that can also go either way.