In my opinion, yes. Dosage can vary wildly from mushroom to mushroom, even from the same batch. The physical side-effects of mushrooms can be much more difficult to deal with (in my experience, it is way more common for people to have intense vomitting on mushrooms than on LSD).

Furhteromore, mushrooms contain many more chemicals than just psilocybin/psilocin; they are often unsanitary(especially mushrooms that are found rather than grown). Assuming that you've got actual LSD, there's not much chance of it being contaminated with anything that will have any effect at the dosage level (consider: people typically dose mushrooms on the order of grams, while LSD is dosed on the order of a couple hundred micrograms).

I've never known anyone to eat several grams of LSD (this would be quite expensive),but even if they did, I suspect they'd just be largely catatonic for a day or so, and have minimal memory of the experience.

While it is, of course, possible to massively overdose on LSD, I think you'd be better off than if you overdosed mushrooms on the same scale.

While we're on the subject of dosage - I've found that people tend to have a harder time physically if they take too little LSD. Taking "just half a hit" is not recommended - On a proper dose, you'll have a bit of "body load" for a few minutes, but the psychedelic experience will take over and overshadow any physical discomfort. At the range of ~75 micrograms, I've seen people just feel twitchy and uncomfortable for hours.

Of course, YMMV.