You can get prison time for growing them in the US, depending on the state (spores are legal here too, no psilocybin).