Depends on how far you want to go with "English-speaking", but Sri Lanka also fits that bill (warm weather, English widely spoken, affordable, at least locally).

I still think SA loses more than the poor UK tourists who have to stomach going to Madeira or Morocco and listen to heathen languages instead of SA.