This is nonsense, although it may depend on the kind of job you have. For most of us, we don't need to be there five days a week. You can plan around that.
Of course if you have five people in a team and everybody has a different day off, you can never get together, and that may be a problem. This is the same if you and your colleagues work many days/hours out of the office or at home.