Pot does produce physical changes in the brain, though. Heavy pot usage can dramatically increase the amount of anandamide receptors in the brain, which regulate hunger, motivation, pleasure and mood among other things. So quitting and having a neurotransmitter deficit until the brain returns to homeostasis causes hormonal and physical effects on the body... How is that “only” psychological?