As a manager I love seeing people have side projects. I've also learned it's pretty easy to figure out where their priorities lie. So, I think letting them know is generally a good thing, just be prepared to let them know everything if you do.
And yes, anyone with a manager like the one you describe should absolutely run for the hills :)