People who claim that "The Congo" is offensive don't say that because it's not the official name (which it is), I guess they just presume that there must be some colonial racist reason, and not just the fact that it's named after a river.
"Republic of the Congo", or "République du Congo" in French, "du" being a shortened form of "de le", "of the". Other French speaking republics just have "République de N".