It is as though your 'home state' continued to tax you (or make you file paperwork) long after you've moved to California. Nobody else (worldwide) does this. It doesn't make any sense.
This is a primary motivation people have for renouncing U.S. citizenship.