They had the right to self-determination, just as the 13 rebel colonies did in seceding from Britain. But they gave up that right a-priori by enslaving an entire section of their population. The same could be argued about the American Revolution, but Britain had not raised any significant complaint about colonial slave-holding, so had no real standing from that perspective.