Check out "The Four Tendencies" by Gretchen Rubin. It describes almost this exact scenario and provides tools that may help you overcome it.