Therefore, I understand and accept that free speech is a foundation for a civilized life, that there should be no restraints on free speech.
But, I also acknowledge that free speech isn't so free at all. For a long time and in many places in the world there are minorities without the right to speech. And the barriers aren't just authoritarianism. In many places, even in democratic countries, there are non-formal mechanisms to restrain the speech of women, ethnic and sexual minorities.
When an European soccer fan shouts "monkey" to a dark skinned African or Latin American player of an adversary team there is a lot more than free speech at play (e.g.: google for "Vinicius Jr Valencia"). There is the fact that the power of black people to respond and argue is severely constrained in Europe, even more with the rise of anti-immigrant right-wing parties. The key issue here is that the channels of expression are not free, are not open. The same thing goes for, say, women in South Korea, Christians in Muslim countries, Muslims in India, native American people in Latin-America, etc.
Wanting "free speech" to justify oppression of a minority that is already constrained in their speech is not exactly advocating freedom. A lot of times it is advocating hypocrisy.