The issue is that a USB charger is not a USB power supply. A charger does its best, but makes no guarantee of constant power delivery or duty cycle. The power supply absolutely must provide its rated output at 100% duty cycle.
Literally nothing inside it uses that voltage, so it'll just get downconverted to the single-digit voltages the chips actually need.