A lot of people complain that Face ID doesn't work when they wear skiing gear or a mask. I'd argue that most humans can't identify me when I wear a mask, so it's a bit hard to expect my phone to do better.
I do prefer Face ID for almost everything except payments. Apple pay with Touch ID was a much better experience. The awkward double tap + stare at my phone for 2 seconds isn't great. Having an Apple Watch makes this much better but I do miss placing my phone near the reader and putting my finger on the sensor.