However feel people 'emotionally' about things like that, justified or not (ie racist/overly 'patriotic'), they failed to realise that we'd all be worse off. There is no upside.
And yes, I'm saying lots of people voted with their emotions over things like that, thinking it would stop it. (Thanks to Mr. Farage et al.)
Laws. Money. Borders. All of which we already had control of. Just clearly not very good at. ;)