I work on my side project every spare minutes I have. Tools that I create on the side have benefited my employer so much. If they were to give me a hard time it will be their loss. I can always quit and work in my own, smaller pay check but you get peace of mind.