I think he meant if he leaves, his coworkers would have to take on his tasks. That’s why I like sprint based development - if my boss wants me to do something unplanned, he has to remove something planned first.
The workload is determined by the employer, not the workers.