I used Windows Hello on my Lumia 950 for a while back in the day and it seemed fine. It did the recognition work on-device and didn't involve sending anything to "the cloud," which was nice.

But yes, I eventually turned it off for the same reason I would turn off fingerprint authentication.