That's not opinion, it's fact, regardless of the motives for doing it.
> it is rather intimidating for women to get into Computer Science when they walk into a 95% male classroom
Did you intuit that, or is that the result of a real, repeated study?
Are you offering something similar for the men? That's what would make this fair.
And do you tell the women they are going to need to learn to interact with men as part of a professional programming job? Are they only ok with that if they are in the majority?
I suggest you don't perpetuate the problem / don't participate.
You could politely decline to participate and provide your reasons for doing so. If your department feels strongly enough about it then let one of them volunteer to do it. If no one volunteers, then obviously they don't feel strongly about it. Your declining to participate sends a strong message.