The birth rate in Switzerland (just as in many highly developed countries) is already way below 2.1 children per woman, which would be required to sustain the population. Any population growth comes from immigrants. Xenophobic people are scared by that.