I've opted out every time I traveled prior to the introduction of (opt-in, non-frequent flyer based) Precheck, so 8-10 times per year from 2010-2014(?) and never had a notable issue.

As the other child comment says, rights atrophy if you don't exercise them.