I agree with you entirely. I read recently that the population growth of downtown Toronto has tripled in the past five years. Assuming that is a trend consistent with most major North American cities, the cost of housing has to compensate.
http://www.mrmoneymustache.com/2015/07/27/rent-vs-buy/
Of course, you might not agree with his math.