I don't think you understand the word colonizer. The Muslims conquered and lived among the people. They created a civilization which non-Muslim minorities were a part of. This is very different from European colonialism that extracted resources from the lands and people they conquered for the exclusive benefit of the Empire.