I agree, I find Apple Pay to be far more fiddly to use than contactless. However, one advantage of the phone based payments is that they can have higher usage limits. Contactless is only allowed up to £40 (I think?) in the UK, whereas banks might allow larger payments with the security of a fingerprint-based payment.