Except that'll impact everyone, not just office workers who might be able to do that kind of thing.
Roads have a finite capacity (you could increase vehicle speeds in order to increase capacity, but you'll run into hard limits); you properly price that capacity based on time of day. If you can't reduce demand with dynamic pricing, you will exhaust supply (in this case, congestion occurs) in short order.