I'm curious about these white anti-white "racists" or black anti-black racists. I realize that people internalize racism in different ways so I definitely don't discount the idea that black people may conduct themselves in ways that demonstrate prejudice against black people, but I've heard never heard accusations that PoC solidarity groups represented by black people (which would be the closest example I can think of) are racist against black people. Perhaps a better example of what I think you're trying to communicate would be "trad-wives" who reinforce certain elements of the patriarchy.
The prime difference between trad-wives and groups like JVP, I think, is that trad-wives advocate for trad-wifery because traditional gender roles appeal to their values or interests, rather than out of a sense of social justice and equity (which are likely not important to them).
However, I'm not at all shocked that there are Jewish people who find JVP problematic, and I'm not sure where you got that idea.
I'd guess something like 50% of practicing Jews in the diaspora hold beliefs that Jews are intrinsically better than non-jews, and perhaps a sizeable minority of non-practicing Jews as well. This is based on my own experiences growing up in a Jewish community as well as the arguments used by Zionist Jews in support of Israel. The Jewish school I went to literally taught that Jews had a more legitimate claim to peace and safety in Israel than the Palestinians, by virtue of being the chosen people.
Reducing all criticism of the ethno-state that results from such beliefs to anti-semitism is an underhanded tactic that twists the meaning of the word in order to manipulate public opinion.
I don't know too much about JVP as they don't have presence in my country, but I just did some reading (including their core values[1] which are far from anti-semitic) and found a lot of the same tired arguments: their "admin" lives in lebanon (not said: one of 18 admins on their facebook page), it's a front for non-Jewish antisemites to rally under the banner of Jewishness (not said: their board and leadership are all Jewish), they said "XYZ" which can be interpreted as antisemitic (not said: either an anti-semitic person or even a plant said something while claiming to represent the group, or what was said was a criticism of mainstream Jewish Zionism taken out of context)
Add to that a lot of the same criticisms typically levied at leftist groups, some of which may actually be good-faith, fair criticisms, but unrelated to anti-semitism.
I certainly agree there can be Jewish anti-semites, but they're much more likely to gravitate to the right than the left.
[1]: https://www.jewishvoiceforpeace.org/about/#mandate
edit: I'll say this one additional thing: I've personally observed a high correlation between Jews who call anti-Zionist advocates anti-semitic, and Jews who secretly or not-so-secretly have a belief that Jewish people are inherently better than non-Jews (and for many this goes down to ethnicity, I'm not talking just about spiritual practice). To me, it seems like they're generally oblivious to how similar beliefs (by any group that holds them) are a type of problematic prejudice, and critical of leftist Jews because they represent a threat to those deeply-held beliefs of supremacy.