Apple may not retain the data, but the underlying card issuer does.
I trust Apple more than Visa or HSBC to keep my data from prying eyes.
If someone could make apple pay be backed by a local bitcoin wallet, then I could feel far more secure nobody is going through my payment history.