Another way to avoid this problem is to have 4 trustees and to split the key between them using Shamir's algorithm, so that 3 trustees are enough to reconstruct the whole key.