Do you do those activities for the joy of it or for self-improvement/another goal?
The way the book talks about leisure is that it's time you spend not striving for things. An example she gives is going for a walk without focusing on how many steps you're taking.