If what you love is building finance-directed B2B desktop apps then, yeah, you're golden.

I think the key is directing your passion in a broad enough way that you can satisfy an unaddressed market demand. If you love building challenging software, there are many ways you can pragmatically apply that passion if you cast your net wide enough.

On the other hand, if you love building socially directed news-ranking sites with clickable arrows, your options will be somewhat limited.