Well, you're kinda right but houses are the most expensive they've ever been. You need a hefty downpayment which is gonna take a lot from your savings. It's not like houses are given for free now.
For first-time homeowners, you only need 3.5% + closing costs for an FHA. That can represent several thousands of dollars, but there's plenty of folks with $600+ car payments and $100+ cell phone bills living in apartments, so it's not like saving up $10-15K is completely unreasonable.
OK where I live that's impossible, you need 25% down and it's very expensive, realistically it will take most of your savings. For 3.5% downpayment, if the interest isn't too high, I'd take it yesterday.