OP may be a libertarian, but you can't determine that from what he posted. There is a strong conservative case for fighting segregation enabled by zoning. I'm currently living in a rich suburb of DC. The local high school, one of the best public schools in the country, is underenrolled. Per student spending in this county is far lower than in DC proper, because we're not trying to make up for all of the consequences of segregated inner city neighborhoods by ineffectually shoveling money at schools. If we could get some lower-income people into dense housing in this area, we could replace expensive DC teachers with cheaper Fairfax County teachers and probably achieve better outcomes for kids to boot.
A lot of the symptoms liberal policies try to fight are caused by the underlying disease of segregated cities and suburbs. If we had more integrated communities where minority populations weren't relegated to looking in from the outside, the demand on the welfare state would go down.