I find that it's precisely when I'm mired in these "day-to-day worries" that I find shrooms most effective at breaking me out and getting a renewed sense of relative priority.
I can understand your concerns about a "terrible trip", especially since these type of worries typically make me paranoid and anxious when I'm on cannabis. However, I've found that when I do shrooms the psychedelic experience always side steps these anxieties completely and reminds me that these concerns are not the core concerns I have.
What's different about doing shrooms as an adult is that I'm not like "whoa, all this stuff isn't real!", I already know that. It's for those times when I feel daily stresses slowly crushing down, am fully intellectually aware that these things are ultimately not important, but can't quite find the emotional release. Shrooms aren't a miracle cure, but typically I'll feel a bit refreshed for quite awhile. As a teenager shrooms are about changing your perspective of big, metaphysical things "whoa man!", as an adult they're about changing perspective on those small things "oh right, performance reviews really don't matter." The insights are the things you, for the most part, already knew, but have been too distracted by daily life to really realize.
I had bad trips when I was younger, but being older and knowing both myself and psychedelics better I find I am much better at keeping myself from spiraling out of control too easily, and much more deeply feel the wisdom of "there are no bad trips". The other nice thing about tripping as an adult is you have much better control over the scene portion of it.