Trust me. I've been dealing with this for years. I have somewhat of an unfair advantage in this department. If you don't take care of what's most important (i.e. most of your time), then the little time you do have will be of little value to you.
I will give you an example. My friend wonders why he has a poor diet. He says he knows he should eat better, but he still makes poor food choices. The answer? Because he is failing at the most important things in life. His career. He's desperately confused on the inside, lost, and scared. At 25, living at home, having a pointless and worthless degree, I would be too.
It's like that story... here: http://www.wow4u.com/theprofessor/
Once you take care of the most important, all the less important stuff is easy. In your case, take care of most of your time... your mentality in your spare time will change completely.
(And start journaling your fears and beliefs)
Peace.