The weak link in creating ever more complex homes, with ever more stringent building codes, at faster rates, is to remove the "humans with nail guns and drills" from the construction process.
At some point, us meat sacks are the weak link in optimizing an industry. Humans can only go so fast. That's why (as you've said) we've seen massive gains in productivity for other manufacturing industries.