What about the argument of these regulations not existing in the first place were it not for the EU?
Maybe it wouldn't be that much worse, but certainly not better than what we have today.
In CS terms, the EU turned an O(n^2) problem, bilateral agreements, into an O(n) problem, everybody trying to get their view into a single body. The advantages should be obvious to anybody knowing O notation.
Again, not to say EU doesn't have problems. But dismantling the EU is not the solution. Improving it is.
Now, of course, it's extremely hard to logically argue against these. But that doesn't mean they aren't extremely annoying to deal with at times.