Building the walls of a concrete block house doesn't take much over 18 hours of labour either. You can't go up more than ~6 feet in a day because you need the bottom layers to gain strength before adding more on top, so you end up doing ~3 6 hour days.

This could be optimized further with things like block feeders/lifts to bring the blocks to the worker.