For this reason I have been experimenting with going cash only. Its actually not so bad and I can easily give money to those in need on the street.
I was once asked by my bank why I wasn't taking advantage of of the convenience my contactless debit card offered. I said because I didn't want them knowing what I spent my money on.
This led on to me being advised that I would struggle to get loan or mortgage facilities because the bank would be unable to see if I was spending my money responsibly.
I can live with that.