Oh, the differences are very very marked. Sure, psilocybin and 4-HO-MET aren't going to be that different (even tho I swear I can tell them apart if I dosed blindly), but giving some examples:
2C-X family gives me some very weird sensation on the chin before I even feel the main effects. Also the visuals tend to be techno-alien-geometric-engineering-architecture themed if that makes any sense. Also, especially 2C-E in high doses, creates time/perceptual distortions I haven't experienced with anything else; as in, I say something to my buddy, go to a different room, and hear what I said with my own voice coming from the original room.
Psilocybin and analogs create a very dreamy, child-like, earth loving mindset, not always very visual, but when visual everything seems to be covered in native-americanesque patterns.
DMT visually is absolutely alien. As in colorful liquid metal moving in very organic ways. The "curtain" for me is basically a sea of colorful alien robot matter. If ayahuasca feels more like psilocybe mushrooms, earthy and human, in terms of visuals, DMT is a supercharged, sharper, edgier, faster, stronger, out of the galaxy and in your face version of such.
After you have oddballs like DiPT, where the mindset doesn't change much, visually there's nothing, but there are loads of audio hallucinations and distortions. My own voice sounds like Barry White on it; most women sound like talking through Coke cans. Slapping a table sounds like drums, and playing drums sounds like dropping cutlery on the sink. Some music sounds better, some worse. Very strange.
LSD and derivatives, my favorites overall, I find them the most malleable by the set and setting in the feelings it can create and the visuals you will see. On the other hand I feel the experience more "on-rails" and even doing large amounts (800µg my max) I felt nowhere near a bad trip. I wouldn't 8x the average dose on mushrooms because the mushrooms have shown me things I wouldn't be able to handle at bigger doses. LSD for me is very, very forgiving.