Aside from the other comments, opioids are much more addictive than psilocybin. All drugs have risks, but the risk of death or serious issues (whether psychosis or addiction) are a fraction of what they are with opioids.