"work" also involves the total velocity change, which means that the trip to employment results in the same amount of total work, regardless of the number of stops made, and which over the total of a day results in 0 work being completed (assuming a round trip from home to the place of employment).
Perhaps the physics definition of "work" isn't quite the right one to use?