You can't arbitrarily take one literally and one not. If they both idiomatic, then they are both equally harmless.
You are equating the Proud Boys with the amorphous "LGBTQ+ friends" community, and then saying that the latter "regularly riot". That's not tenable.
I think you are deliberately engaging in bad-faith arguments. You are literally saying "gay people are the same as organized armed militias." In fact, you said it's "worse."