Having a heat exchanger let’s you exchange large quantities of outside air with indoor air at minimal costs. Trading 70f indoor air with -30f outside air is bad, moving heat between them means could be venting air closer to -10f and only need to heat the new air from 50f to 70f
You still want a quality filter and humidity is an issue in some areas, but overall they can make a huge difference.