You're absolutely right. Whenever I've received a very stern scolding from a Mormon friend or family member over my decision to stop participating in Mormonism, I've tried to respond by saying that I'm grateful for their deep concern, which demonstrates that they care about me.

It would be nice if we could all believe what we want to without consequences to our relationships, but unfortunately that isn't a realistic expectation in many (maybe most) religious communities.