In retrospect, no. But reality was never so clear cut, especially contemporaneously. Lynchings of whites wasn't uncommon. The so-called "last lynching in California" was of two white murder suspects: https://en.wikipedia.org/wiki/Brooke_Hart#Lynching_of_Thurmo... The application of lynchings were, however, disproportionate, and this must have at least been apparent to anyone who cared to consider the question. According to Wikipedia, between 1883 and 1941, "3,265 were black, 1,082 were white." https://en.wikipedia.org/wiki/Lynching_in_the_United_States

Accounts of lynchings also emphasize the treatment of black bodies as evidence of disdain. But even lynchings of white victims often involved mutilation and the taking of "souvenirs", as in the aforementioned lynching. Again, no doubt this was disproportionate, but even the most obvious sorts of discrimination aren't as "black & white" as popular narratives would have you believe. (NB: I'm not challenging the idea or existence of disdain regarding black bodies.)

I think these finer distinctions matter because they're fundamental to understanding the concept of systemic racism--arguably, there really is no other kind but systemic racism. To sell the idea of systemic racism, we tend to shape historical narratives to better fit how people conceive of racism. But taking that license can be counter-productive as it then makes it easier to refute or justify claims of racism, or the very notion of racism, particularly for those so inclined.