A _lot_ of hobbyists (me included) disagree with you on this one. I think the current Remote ID law (controversial, yes) is a reasonable balance.
Also, domestically, we have all sorts of school shootings, etc, that don’t make the news.
I’m sure if someone in power wanted to ban commercial drones, they could run a propaganda blitz and get the outcome you describe, but we’re pretty much a post-truth society at this point.
Pretty much any high-profile assassination with drones would probably have the support of at least half the population (or even more, in the case of the recent healthcare CEO assassination).