Let me add that blocking outgoing requests to non-standard ports should also not break payment systems, yet I've encountered exactly that.

If your checkout system connects over anything but port 443, you done fucked up.