They were right. This tweet is from a guy who deliberately tried to push the limit. I doubt the same thing will ever happen to a normal user.
I have hundreds of virtual credit cards that are all merchant linked. So, now I know that I shouldn't be trying to store any of those in my Apple wallet.