This is the main reason why psychedelics are so high risk - the variation of the experience makes them hard to recommend in any serious way.

It's not even a bad trip necessarily, a positive trip can still cause after affects, increased risk of psychotic episodes, or pretty severe anxiety and it's very hard to predict whether or not you'll be unlucky.