$10,000 of a million is worth less to the millionaire than $10 to the poor person with only a thousand to their name.
A flat tax isn't fair unless every other form of expense was flat as well. Which means rent would have to be some percent of your income and the same for power, healthcare and so forth.