If 60% of women don't want kids, but the remaining 40% all have at least three each, population would still grow.
Anyway, I think you're discussing semantics here. Saying something is 'normal' does not necessarily imply the converse is 'abnormal'. In general 'normal' does not mean 'the norm' or 'according to what the majority of people think', just that it's not completely crazy to think in a certain way.
I definitely consider not wanting to have kids to be normal, no less than wanting to have them. There are very good reasons for deciding you don't want to have kids, maybe even more so that the opposite. In fact, most reasons for wanting to have kids are pretty egocentric if you ask me, and the number of kids growing up under terrible circumstances kind of seems to confirm that.