No, you listen to the reason he refuses to deboard. If it seems like a good reason to the flight crew. e.g. he is a doctor, etc. then you let him stay.