Yeah but the existence of self-censorship implies a fear of social sanction, so if people are still doing it society is still being censored for fear of social sanction.

Remember we're talking about absolutism here, obviously we shouldn't actually be concerned with self-censorship, but it is an obstacle to ABSOLUTE free speech.