Unless in your circumstances it's easier and safer for him to just say yes. In that case go right before lunch, or late in the evening --I guess.