You can't get passion for a subject by dedicating a majority of your daily hours on it? Seems like that could be the very definition of passion.
I get what you're trying to say, but I firmly believe you are wrong.
> I'm trying to make it a point to spend at least an hour a day bike riding or roller blading or just even spending time with my wife.
One hour out of 15 you spend awake? Seems like your hobbies are getting the short shaft here. But then again, so are you - having a diversity of experiences will make you a better programmer by opening your mind to other experiences, rest, and the time to allow your brain to bake a problem into an elegant solution.