Conversely, if the only value you add can be codified and delivered as work packages without physical contact with your peers, what makes you think that you have more value than someone offshore / a robot?

If you're doing real, creative, problem solving work, then daily physical contact with your colleagues is essential. The bandwidth of knowledge transfer is vastly in excess of anything that can be done remotely, and quickly bouncing ideas off other people will get you through problems and blockers far more effectively than anything else. We still don't have any collaboration software which can replicate this experience.