I think that the problem is exactly that paypal and credit cards try to solve the trust issue, but they do it in a simplistic way that heavily favors the buyer.
Let payments be payments like cash, and solve trust issues separately with things like escrow services.