That still leaves a huge pool of speakers. Probably not enough to make it the 'most spoken language in the world by 2050'[0] because it is mostly spoken by educated and urban people, and far less in the countryside, but enough to make it a dynamic, growing language.
[0] : http://www.forbes.com/sites/pascalemmanuelgobry/2014/03/21/w...
[1]http://en.wikipedia.org/wiki/List_of_countries_where_French_...
Rwanda in particular is not in practice really part of French-speaking Africa anymore. The numbers you link show only 3% of Rwandans speak partial French, which is barely more than any other country where a handful of people choose French as a foreign language in school. That's related to the ethnic unrest in the country; much of the current elite are ex-refugees who grew up in Uganda, which is not Francophone, and there's also a political edge to it because they consider France to have been too close to the previous Hutu-dominated government.
http://www12.statcan.gc.ca/census-recensement/2011/as-sa/98-...
It also doesn't seem true that Allophones (born not speaking English or French) necessarily are using English the most as their 2nd language. Allophones using French most often at home is increasing over time.
http://www12.statcan.ca/english/census01/Products/Analytic/c...
Going outside Montreal will yield 90%+ French speakers.
Historically the downtown business core of Montréal was Anglophone while the poorer, rural areas were completely Francophone. However, rural people could still vote: the result was the 1976 provincial victory for the Parti Québécois who immediately introduced far-reaching legislation requiring the use of French in public places, in the workplace, etc. The effect of this was to make Toronto Canada's primary business center.
There are still some English areas, I think mostly around McGill. Most of the city is completely French though.
As an English-speaker with only a rudimentary knowledge of French, I found Paris a lot easier than Montréal to get around in. In Paris, as long as you can remember to start with a nice "Bonjour"/"Bon soir" everyone I spoke with was happy to help in English as best they could. In Montréal, language is so politicized that doesn't work. To be fair, once people found out I wasn't from Canada they would be friendly and helpful -- their first assumption, though, would be that I was probably just someone from Ontario, must have had some French in school, and now am just refusing to try.
I am well aware of the treatment you get as an English speaker in Quebec. If they think you're non-Canadian, they are super friendly. If they think you're Anglophone Canadian, watch out!