Two of the most cycling friendly cities in the world are also cities with a lot of rainy days (Amsterdan and Copenhagen). A lot of people with kids there will disagree with you.
It seems to me the biggest issue people who never cycle think stops people from cycling is weather, while in reality it is unsafe infrastructure. Build the infrastructure, people will cycle and will not bother about the weather.