I live in a post-Soviet country that has district heating systems, and rather quickly the demand for heat outstripped the demand for electricity, so in my city this is now mostly fulfilled by 'heat plants' burning gas. The price you pay per kWh of heat is quite a bit higher than you would pay for having a gas furnace or heat pump at home, so I'm not sure how efficient it is.
Also the heat plants are not that far from residential areas, so if they were to burn more polluting fuels (apparently when they were built, they burnt bunker fuel) it wouldn't really be any better than burning at the point of use.
If you have some kind of geothermal source (proper geothermal, not a ground source heat pump) it seems like it would make sense, but if not I think heat pumps at the point of use are a much better solution. In apartment blocks you could have a centralised system for the building, you don't need each unit to have its own system.