The cost of raw wood is not a big contributor to the cost of housing. The shortage of land where people want to live and are legally allowed to build is the biggest problem. Behind that, cost of construction labor.
The carbon in the wood used to build houses will slowly (or rapidly in the most unfortunate cases) release back into the atmosphere by various mechanisms.