Weather does affect spread, because it affects how often folks go outside, where and when they interact with others and so on.

In any case, you've fixated on one similarity and missed the larger point. Comparing Sweden to its immediate neighbours is a stronger comparison than any other. No other countries in the world are as comparable, not even close. When you control using that natural experiment, Sweden comes out much worse.