There's a book that addresses that, and might be helpful to you: "When I Say No, I Feel Guilty" - Manuel J. Smith