Is this actually true? In Germany at least, vacation from work is not truly our own time. We are legally required to use it to relax and restore our capacity for future work. Few people probably see it that way, admittedly.
Of course, there is still a huge difference, but it's awkward to view everything through that us-versus-them lens.