I’ll take the convenience of using FaceID over the possibility of being in a situation where it’s used against me. I don’t think that people should be generally worried about these scenarios.
From your point of view, the logic goes "the chances are low that I'll ever be in one of those situations". Well gee, how nice for you.
But for the bad cop, you created the condition that wherever they go, whoever they DO happen to interact with, they always get away with whatever they want. They swim in a sea of all open book victims. The people they do abuse all think the same thing you do.
You should generally be worried about your house burning down even if your house has never burned down.
That would be like euthanizing every dog on earth because a person might be killed by one.
~30,000 people are killed by dogs every year.
How many times annually do people have their phones unlocked by police without their consent?