To be clear, there's nothing wrong with thinking of children (or the immunocompromised or handicapped or any other group). "Think of the children" is an argument where you use children to justify an absurd, overblown, or bad faith argument.
You seem to think it means "I shouldn't have to think about other people's well-being because freedom." I think that's pretty callous.