My previous psychiatrist said he's had some luck with patients on stimulants lowering their stimulant doses and adding a non-stimulant treatment like Strattera, but his patients rarely had success stopping all stimulants and taking only Strattera. That's just one docs opinion, but having been treated for adhd for 15 years, it doesn't surprise me.
So, consider yourself lucky you don't already need stimulants to get by. Some of the newer non-stimulant options may be effective for you, and you won't have to deal with the "druggy" aspect of being on stimulants for work. Stimulants can seriously affect your life, both positively and negatively. You might be able to get things done that you never would have done before - I felt like I was finally able to compete at a normal level when I started - but you might retreat from society at the same time, be less interested in spending time with loved ones or building relationships, and then there's all the short-term side-effects like trouble sleeping or losing interest in eating.
Basically my experience has been a double-edged sword and it's bittersweet. For every way that it's benefited me, ADHD meds negatively affect me in some other way and it's hard to quantify the net balance.