Addicted and losing your job because of psilocybin? I've not tried it myself, but many of my friends have, and anecdotally, none of them have (to my knowledge) ever even gotten to the point of it being a "habit".
I can't say the same for alcohol, cocaine, and even cannabis. I know people who have had problems with all of them.