That's only true if your team is miraculously self-sufficient. Also, good managers don't need offices.