My understanding is that economically it was usually a mutually beneficial arrangement, and servants often ended up better off than a normal immigrant. The second-class status of servants is somewhat hard to stomach by modern standards, but honestly it is not much different than the way members of the military are treated (source: I served five years enlisted in the US Navy).