I'd be as worried about false positives and false negatives as I would be about losing privacy - and I would certainly be worried about that.
Of course, the security of actual boarding passes seems extremely flimsy compared to the rest of airport security. The airlines could just take a picture and do no more verification at all, and wind-up with current security.