Building a local profile of faces observed on a single person’s property isn’t problematic for me. In order for the police to search it, they have to issue a very specific warrant for a specific addresses’ surveillance data. Its also anonymous by default - while you have the face, the data is local and isn’t attached to any “network” of facial recognition software. Its not being used to track people moving from house to house, or business to business, to build a “model” of their behavior to manipulate them. It’s specifically “what footage do I have locally of this face?” which can be extremely helpful when securing a home.
This is in stark contrast to what I worry companies like Google do (Facebook has been caught doing it): building shadow profiles of non-users that track behaviors across all places their face shows up (surveillance footage, personal photos of other users, etc.). This is a network of information consolidated into a single point. You have no reasonable expectation of privacy in public, but I do believe you should have a reasonable expectation that people aren’t stalking your every move across many properties and aggregating that data into a single source law enforcement can get access to with a single warrant.