In most countries, the states get their power from the delegation of powers dictated by the union/federal constitution. In US, The union gets their power from the few matters that were delegated to them from the states.
For example, India used to have such disparity in consumption taxes (not income tax) which was recently removed and simplified. The federal govt collects all consumption and income taxes and devolves the receipts to states based on pre-defined formulae enshrined in law.
Edit: In an ideal world, instead of filing separate state and federal tax returns US should move to a common system where tax can be collected/enforced by one entity and the receipts devolved to states as per certain rules. This will remove income tax disparity between states and equalise business/opportunity costs (No more Delaware tax havens for companies to skirt taxation). This will simplify a lot of things. Most countries including mine have such a singular system.