Because it’s an unfair playing field. Government is supposed to be a check on corporate power - not guaranteeing it with unfair advantages.
On the non business side our tax dollars are going to support billionaires. At the national level this is pretty close to zero sum. Every dollar Amazon doesn’t pay is a dollar someone else has to. Discrepancies between regions would be solved more efficiently with transfer/equalization payments.