And? This is only "unfair" if you assume that people should be taxed as a percentage of their income, but by moving to consumption taxes we discard that assumption.
More likely, we would heavily tax goods that poor people cannot afford. Things like dining out, travel, fashion, electronics, cars, and housing in excess of basic sq footage.