Yep. As someone who has been taking these medications for over a decade, I can say the danger of physical and mental addiction is very real. I've also stopped medication several times over this period and the withdrawal can last weeks or months.
Have also done breaks and it’s hard, but it’s confounded with the accompanying massive drop in life functioning. I’d argue it’s 50/50 but anecdotally. The research on street addiction of amphetamine (think homeless not Ivy League SAT prep) and recovery is fairly robust. Doable but hard.