Political power was tightly held by the Afrikaners in the era of Apartheid South Africa, 1948 to 1990s.
But as you say, that did not mean that English speakers were "powerless". They were merely half a rung down on the apartheid social ladder. And still near the top.