In fairness, some of the people being punished here are the car manufacturers, who didn’t support Brexit, because they knew (and did point out at the time) that stuff like this would happen.
It doesn't really matter since exempting the sectors that oppose it knowing they would be hurt would make every free trade zone exit ideal for the exiting country.
Getting hit on the head because someone held a brick over it and let go isn't a punishment, it the consequence of an action. Car manufacturers aren't being punished, their business is suffering the consequence of an action taken by the British government.