Your only justification for forcing people to come to your office is to suit your needs. If a role can be done successfully 100%, people like you need to think about others before you start supporting upsetting someone else's lifestyle to make yourself happier.