It's significantly more efficient to provide services to compact towns than sprawled towns, so I'm not sure this registers to me as a downside.
It's pretty common for small sprawled towns to struggle to keep up with maintenance of roads/water/power, which is less of an issue with compact towns.
The same applies at the city level, of course.