They could theoretically leave, but if they have serious unresolved disputes with their host country, it could very well prevent them from leaving by using force. What then?