It's still a great idea, and the fact that you have more experience and a real passion for it means that you'll most likely out compete your peers.

The best piece of advice I can give is that at the end of the day, do what you feel is best for you personally and don't pay attention to what your peers are doing. The programming landscape is LARGE.