I've been battling with this exact sentiment. I want to spend time skill-building, but my wife is a definite priority.

You're right, 3 hours on Wednesday, and getting up early on a Saturday morning is plenty of time to learn something new, or apply the skills you have to a side-project.