Comments here suggest you're in the majority with your experience, though I wonder if there might be a little participation bias with regard to strong memories of such bad policies.
As a contrast, at my school the policy was far more reasonable: you still needed permission to leave, but if you didn't abuse the privilege—using it every day, or disappearing for half the lesson—the teacher wouldn't give you any grief.