Yep. I would want to hold the CEO's passport and bank account credentials because they seem like a flight risk.

(Something similar happened to a friend of mine who lost a $300k final payment because their friend/roommate took it and fled the country.)