I agree with your assertion that there is a big difference here, in that anti-abortion protestors are far more likely to resort to domestic terrorism to get their way.
Pro-choice protestors don't have a history of bombing health clinics, that's something reserved for the people you claim "take peaceful action". History has something quite different to say: https://www.vox.com/2015/12/1/9827886/abortion-clinic-attack...