It can be costly but it doesn't have to. You pay extra for comfort, looks, low weight and obviously the branding.
Warmth itself is cheap if you accept clothes that are a bit heavier and maybe not ultra-breathable. Adding a pair of cotton long johns and a cotton long sleeve turtleneck underneath whatever you are wearing can easily keep you warm, it's just not super comfortable and not super fashionable.