This 'master-master LDAP setup' sounds a lot like mastodon's federation (not login with Google federation) and the problem with that is an user often belongs to many communities or may change from one main community to another during his life, so he would lose all his data when moving.