The only issue I ever had working remotely was when my (now ex) wife thought I was talking to her while in a conference call.

"I know it's going to be tight, but we'll make it fit".