There are also the many valid awful ways it which it can be used, particularly by the government. Why not just ask for laws preventing the bad uses? I don't get why it has to be all or nothing. If it's strictly government use that is concerning, or police use, then pass laws banning government collection of facial recognition models. There's no need to pass laws banning all forms of racial recognition simply because there are certain dangerous use cases.
It'd be like if back in the 20's or 30's someone said we need to ban cars because they could someday be driven by terrorists into large groups of people. It's a tragically valid concern, but we all agree it's not reason enough to ban cars altogether. An even more realistic example is folks back in the day complaining about how dangerous cars were, and rather than banning all cars deciding on speed limits and safety belts and airbags and anti-lock brakes and so on. It doesn't have to be all or nothing.