That actually happens - https://en.wikipedia.org/wiki/Government_in_exile is the term of art - https://en.wikipedia.org/wiki/Latvian_diplomatic_service_in_... is an example of basically exactly that with regards to Latvia.