You must tell the agency first and leave all further client communications to them. The client is theirs not yours.