While Visa and Mastercard are the big fish in the sea, they do have competition. There is also Discover and American Express. They also charge similar rates, which suggests that 3% fee isn't random. Not sure where 4%/5% came from, fees average out to somewhere between 2%-3% for small merchants.