The original meaning of "barbarian" was akin to "not Roman" or "foreigner" (more precisely, someone not belonging to any of the classic civilizations).
Akin to "villanus" (someone living in a village), it took a derogatory tone later, as someone "uncivilized", but that was not part of its literal meaning.