They believe they should dictate the behavior of other people, that's fundamentally asymmetrical to the counterpoint. The "other side" is not advocating compulsory abortions, they are advocating individual freedom to make a deeply personal decision. The people that want to ban abortion for all people are taking away rights from people they disagree with. Who cares what they think, indeed.

If I want to disband and illegalize the Southern Baptist Convention because I sincere believe they are heretics, who cares about my sincerely held beliefs about what others should do? I should should just not go to a Southern Baptist church.