To be honest I think that the Chinese government would not care or actually be quite OK with it.
Indeed, who would leave HK? Arguably the anti-CCP, the "troublemakers". So that'd mean less 'trouble' in HK and there is a large supply of mainlanders happy to move to HK.
Obviously the Chinese government will officially be outraged but privately they may think good riddance.