I think "via PayPal" is the key distinction that makes the fraud excuse less valid.
For example, an annoying system which will decrease chargebacks is "If your IP address goes to a country other than your billing address, shoot first and ask questions later." It bites me all the time, but there are sensible business reasons for it.