Wouldn't then all the fraud risks move to those businesses which take consumer credit cards and exchange them for bitcoins. So why would the aggregate fraud cost in the system be any lower ?

Also, I seriously doubt that 2.5% fee is all cost. Visa/Mastercard, etc. are massively profitable - they have plenty of room to cut those fees