Yes, one needs to be careful and get good medical advice. Testosterone also has a link to prostate cancer, where one of the main treatments is blocking it (androgen deprivation therapy). There doesn't seem to be strong evidence it causes prostate cancer [1-3], but unless there is compelling reasons to try testosterone one can be careful & try other things first (starting with exercise, meditation, mindful walking). Also, even if one has "low" testosterone levels it may be that one's androgen receptors are more sensitive to it.
[1] https://newsroom.uw.edu/news/study-testosterone-therapy-does...
[2] https://prostatecanceruk.org/about-us/news-and-views/2017/11...
[3] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4647137/