As much as it pains me to say this, because i myself consider de Gaulle to be a fascist in many regards, that's far from a majority opinion (disclaimer: i'm an anarchist).
I think de Gaulle was a classic right-wing authoritarian ruler. He had to take some social measures (which some may view as left-wing) because the workers at the end of WWII were very organized and had dozens of thousands of rifles, so such was the price of social peace.
He was right-wing because he was rather conservative, for private property/entrepreneurship and strongly anti-communist. Still, he had strong national planning for the economy, much State support for private industry (Elf, Areva, etc) and strong policing on the streets (see also, Service d'Action Civique for de Gaulle's fascist militias with long ties with historical nazism and secret services).
That being said, de Gaulle to my knowledge was not really known for racist fear-mongering or hate speech. The genocides he took part in (eg. against Algerian people) were very quiet and the official story line was that there was no story. That's in comparison with far-right people who already at the time, and still today, build an image of the ENEMY towards whom all hate and violence is necessary. See also Umberto Eco's Ur-fascism for characteristics of fascist regimes.
In that sense, and it really pains me to write this, but de Gaulle was much less far-right than today's Parti Socialiste, pretending to be left wing despite ruling with right-wing anti-social measures and inciting hatred towards french muslims and binationals.