Another counter-point: when you buy a house, even while the mortgage isn't paid off, you can immediately start renting parts of it and end up in a situation where your mortgage payments are equaled or exceeded by your rental income. I also believe that this is taxed differently from normal income, especially so if you're renting rooms in a house you live in vs. owning rental property.
In the Bay Area at least, a single-bedroom apartment is easily $2000 a month. If you play your cards right, a single-family home in a desirable neighborhood for tech workers or others can be had for under $1m with 4 reasonably-sized bedrooms, a garage, and a yard. You can then rent out 2 of the bedrooms at $1400/month each and end up with your mortgage payment from your tenants each month. There are still maintenance costs and very significant property taxes (~single-tens of thousands per year on such a property), but you also build equity, which you can later sell (minus the mortgage interest). Depending on the mortgage, you could also use this situation to over-pay mortgage payments in order to pay off the property faster and reduce the amount spent on interest if that works out to a better investment opportunity than anything else you could do with the same money (any early payoff penalties included).
It does seem to me that renting is a mixture of paying for convenience and throwing money away, given the above scenario and considering how after 5 years, the home owner ends up with ~$150k in equity assuming the housing market stays flat (it doesn't in the Bay Area, e.g. http://www.paragon-re.com/3_Recessions_2_Bubbles_and_a_Baby ) , taxes, maintenance, and interest included, you should still come out ahead with the house. Once you also factor in that renting gets you 8-20%+ increases in rental price per year, while the house value appreciates on the low end of that range over the same amount of time (and also that you can raise the rent for your lodgers accordingly), you really start to see why houses in the Bay Area are attracting foreign investors and starting bidding wars above asking price for nothing-special properties.
Edit: lastly, the point I feel everyone neglects: unlike other investments, your first property has the additional advantage and value that you can live in it, so comparisons to other investments become quite different. Sure, you could take your down payment and put it into ETFs, and on paper the yearly average gains might look similar, but if you suddenly lose your job, the ETFs won't provide a place to sleep at night.